SQL Basics from a Silicon Valley Data Leader

With the advent of the AI era, building data pipelines has become a core competency that determines a company's competitiveness. Learn how to build efficient data pipelines using Airflow, the most widely used tool, directly from a Silicon Valley expert (formerly Head of the Data Team at Udemy, currently a professor in the Data Masters program at San Jose State University) with practical experience and extensive lecturing experience.

How is processing big data different from processing data with Pandas? Let's learn about Spark, an essential framework for big data processing.

How is processing big data different from processing data with Pandas? Let's learn about Spark, an essential framework for big data processing.

With the advent of the AI era, building data pipelines has become a core competency that determines a company's competitiveness. Learn how to build efficient data pipelines using Airflow, the most widely used tool, directly from a Silicon Valley expert (formerly Head of the Data Team at Udemy, currently a professor in the Data Masters program at San Jose State University) with practical experience and extensive lecturing experience.

mongoDB, NoSQL You hear a lot these days, but is it still an unfamiliar database? Aren't you using it like a relational database (RDS/SQL)? No matter how good the technology is, if it's not used correctly, it will have the opposite effect. That's why we often see cases of failure in using MongoDB. This lecture will teach you everything from basic concepts to practical know-how so that you can use MongoDB as MongoDB-like as possible.

This is a special lecture that can lay the theoretical foundation to simultaneously prepare for the Microsoft AZ-900 certification, and as the latest content reflecting the scope of questions as of May 2025, by providing content related to core data concepts, Azure's relational data, Azure's non-relational data, and Azure's analytical workloads in a form combining theory and practice, it can be utilized as a meaningful educational opportunity to not only obtain the certification but also take the first step towards becoming a data professional.

Real-time data processing is now essential, not optional! Learn to handle real-time streaming smartly with Apache Flink. Batch? Streaming? Even complex concepts can be understood easily and quickly. Hands-on practice configuration where you'll get the hang of it by directly working with Kafka and DB integration! In a world driven by data, start first with Flink.

You can learn the core essentials of GA4 (Google Analytics 4) e-commerce setup—which is often too difficult to learn alone just by searching the internet—through hands-on practice. This course is designed so that performance marketers and beginner developers setting up GA4 e-commerce for the first time can easily understand it by practicing step-by-step on a Cafe24 demo shopping mall. Since we delegate the developer's role to ChatGPT during the practice sessions, even marketers, PMs, or planners without professional development knowledge can learn how to set up GA4 e-commerce.

MongoDB is easy to learn because it uses JavaScript, which is familiar to web developers who haven't learned SQL. This course will explain concepts using everything from the most basic parts of MongoDB to practical applications.

Through detailed lectures and hands-on practice on the core elements of SQL, we will provide you with a solid foundation to grow into a SQL analysis expert.

Learn NoSQL technology for handling big data, one of the fundamental skills in full-stack and data science technologies used by modern startups. MongoDB is the easiest and fastest NoSQL technology to utilize. In this course, you will learn the basics of MongoDB in a short time and master the skills to handle and utilize MongoDB with Python.

Learn the problem definition and hypothesis formulation process, core competencies for data analysis!

SQLD Yellow Book 176 Problem-Solving Course for those who studied but can't solve problems. After completion, you'll go beyond passing to become an expert. SQLD All-in-One Pass!

[Strategic Roadmap for System Control and Prevention of Cognitive Atrophy in the AI Era] 1. Introduction: Technical Initiative and Strategic Command (Strategic Command vs. Passive Dependence) A core insight derived from the past 40 years of automotive R&D and corporate management is that entities that lose technical control are highly likely to devolve from beneficiaries of a system into its dependents. In particular, the proliferation of Artificial Intelligence (AI) technology—comparable to high-performance engines—presents a crossroads: it will either leave humans as "passive passengers" of technology or allow them to leap forward as "strategic commanders" who master the system. The indiscriminate dependence on AI observed today is accelerating "Cognitive Offloading," a phenomenon where humans entirely delegate their inherent thinking and analytical mechanisms to machines. This induces the deactivation of the brain's Executive Control Network (ECN) and carries the risk of a structural crisis known as "Cognitive Atrophy," leading to the functional decline of the frontal lobe in the long term. This course aims to present a strategic methodology to strengthen human cognitive capabilities and safeguard intellectual sovereignty in response to this intellectual crisis. 2. Five Core Methodologies for Safeguarding Cognitive Sovereignty ① Maintaining Cognitive Plasticity and Designing Intentional Cognitive Load (Cognitive Gym) The convenience of AI, which provides immediate and seamless answers, can lead to a disconnection in thinking and the omission of critical review processes. To prevent this, it is necessary to design intentional "Cognitive Friction" within work processes. By counter-utilizing AI's automation functions to forcibly delay and deepen the human thinking process, advanced training must be conducted to stimulate neuroplasticity and raise the threshold of thought. ② Establishing an Adversarial Verification System Based on Multi-Agent Systems (MAS) Human cognitive systems are susceptible to "Automation Bias," the tendency to uncritically accept AI outputs. To offset this bias, it is effective to operate a "Critique Agent" or a virtual "Red Team" that analyzes and attacks the vulnerabilities of the logic, separate from the primary model that follows the user's instructions. This forces the process of building defensive logic, thereby activating "System 2 (deliberative thinking)" as defined by Daniel Kahneman. ③ Implementation of Literacy-Based Dual-Track and RQTDW Learning Methods The ability to verify digital tools is directly proportional to one's analog foundational thinking system. While maintaining literacy to deeply grasp the context of text, it is recommended to internalize the 5-step RQTDW roadmap: Read (Deep Reading): Perform a multi-faceted identification of the source of information. Question (Questioning): Pose critical questions regarding logical consistency and the validity of premises. Think (Confronting Contradictions): Analyze and contemplate trade-offs and logical gaps between information. Discuss (In-depth Discussion): Diversify points of contention through virtual or actual discussions. Write (Reconstruction): Refine the results of expanded thinking into human-specific language for systemic internalization. ④ Applying the Sandwich Workflow to Clarify Accountability Delegating the entire work process to AI poses a high risk of cognitive paralysis; therefore, it is essential to establish a rigorous workflow that structurally separates the roles of humans and AI. Context Design Phase (Top Bun): Setting the purpose of the task, imposing constraints, and designing the overall architecture must be performed under human leadership. Data Processing Phase (Meat): Tasks involving repetitive and large-scale resources, such as calculating vast data, sorting, and drafting, are delegated to AI. Final Verification Phase (Bottom Bun): Ethical judgment, precise cross-referencing of facts (Fact-check), and final value attribution are returned to the human domain of responsibility to ensure system stability. ⑤ Hallucination Control and Strengthening Epistemic Boundaries via the SIFT Model AI possesses the attributes of a "stochastic parrot," combining tokens based on probabilistic frequency without a substantive understanding of meaning. Therefore, one must be wary of the "illusion of knowledge" created by AI's fluent output. To this end, a 3-step fact-checking protocol and the SIFT model must be strictly applied in practice. The habit of "Lateral Reading"—tracking original sources and contrasting them with external data—becomes a key mechanism to prevent intellectual free-riding on technical convenience. 3. Conclusion: The Strategic Mission of the Hyper-Intelligent Helmsman While the phenomenon of intelligence is manifested through engineering design, the core agent that controls it in a meaningful direction and creates business value remains rigorous human thinking. This masterclass is designed to ensure that students acquire the capabilities of a "Hyper-Intelligent Helmsman" who controls the powerful power source of AI and designs organizational systems. Strengthen the cognitive muscles of individual members and actively respond to technical challenges. When rigorous engineering control is combined with advanced cognitive abilities, AI will finally function as a strategic asset that drives the sustainable growth of both members and the organization.

Learn the process of building data pipelines using Apache Airflow from basics to practical application. Understand Airflow's core concepts and architecture, and master advanced design patterns frequently used in practice such as dynamic DAGs, parallel processing, distributed processing, and Custom Operators through hands-on exercises. Set up a practice environment with Python and Docker, and develop practical skills to design and operate real workflows.

Data Analysis that Determines Online MD Performance! Learn essential data analysis and strategy formulation techniques necessary for MDs to maximize sales and profit in the e-commerce market.

[Understanding AI Foundation Models and Their Operating Principles: Engineering Control and System Architecture, Practical Methodologies for Resolving AI Uncertainty and Engineering Assetization] 1. Introduction: The Necessity of Engineering Control of Intelligence (Engineering Control vs. Systemic Chaos) A core conclusion derived from long-term practical insights in industrial fields is that power that is not properly controlled acts as a potential liability rather than an asset. Even a high-performance engine is nothing more than an unstable physical mass if it lacks sophisticated combustion logic and microsecond-level control systems. The organizational chaos currently appearing in the process of adopting Generative AI is judged to stem from a lack of understanding of these control principles and a blind faith in technical "black boxes." This masterclass redefines Artificial Intelligence not as a mysterious stochastic phenomenon, but from the perspective of Model-Based Engineering (MBE). By transforming the uncertain domain of intelligence into a predictable and reliable engineering framework, we aim to present a strategic methodology that allows organizations to secure strong leadership across the entire system without being dependent on technical trends. 2. The 4 Pillars for Solving Core Challenges ① Epistemological Paradigm Shift: Visualizing the Black Box and Assetizing Technical Debt Many companies are facing "technical debt"—characterized by exposure to security vulnerabilities and exponential increases in maintenance costs—by adopting AI models without a clear understanding of their internal structures. This course assetizes this through the following approaches: Deconstruction of Mechanisms: We engineeringly deconstruct the Self-Attention mechanism, the core of the Transformer architecture, from the perspective of numerical weight analysis. By understanding the numerical mechanisms that determine information priority, we visualize the basis for the model's judgment. Analysis of ID Formation: We transparently track the process by which a series of pipelines—leading from Pre-training to Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF)—forms the model's technical identity and ethical guidelines. This converts invisible threats into controllable system parameters. ② Securing Deterministic Reliability: Hallucination Control Strategies to Overcome Probabilistic Limits Large Language Models (LLMs) are not systems that reason for truth, but systems that generate the next most probable token. The "hallucination" phenomenon resulting from this inherent characteristic becomes a fatal flaw in engineering fields where reliability is vital. Constraints of Retrieval-Augmented Generation (RAG): We move away from closed structures that rely solely on the model's internal fixed memory (Internal Weights). We establish an "open-book strategy" that provides clear grounding for generated results by allowing real-time reference to trusted external knowledge bases. Hybrid Model Architecture: We design a redundancy strategy that achieves both accuracy and operational efficiency by deploying large models for areas requiring enterprise-wide knowledge and optimized Small Language Models (SLMs) for specific domains where security and real-time response are essential. ③ Computing Architecture Optimization: Overcoming Physical Bottlenecks (Memory Wall) While intelligence is implemented in software, its performance and economic sustainability are defined by the physical limits of hardware. Physical Constraint Analysis: We diagnose the "Memory Wall" problem, where data transfer speeds cannot keep up with the processing speeds of computing units, and heat generation issues resulting from high-density computation from an engineering perspective. Infrastructure Design Capability: We precisely analyze the physical impact of High Bandwidth Memory (HBM) stacking structures and 2.5D/3D advanced packaging technologies on inference efficiency. We cultivate design capabilities to optimize Total Cost of Ownership (TCO) through full-stack integrated insights that complement hardware limitations with software architecture. ④ Acceleration of Functional Expansion: Transitioning from Passive Tools to Autonomous Agent Systems Current AI remains at the level of simple Q&A, failing to create added value for practical business automation. This course evolves AI into an active subject that judges and executes on its own. Decomposition: We learn techniques for decomposing complex goals into achievable sub-tasks and logically organizing the execution sequence upon receiving them. Digital Workforce Deployment: We define the process of applying "Active Agent" systems to the field, which autonomously call internal ERPs, browsers, and external APIs to complete actual business logic and accept feedback on results. 3. Core Architecture: Closed-loop Control System The way an AI agent manifests intelligence and performs complex tasks is theoretically identical in logical structure to the closed-loop control system performed by an ECU (Electronic Control Unit), the core brain of a car. This course analyzes this in detail from the perspective of the ReAct (Reasoning and Acting) framework. First, the system begins at the Input stage, receiving ambiguous and complex requests from the user. This plays the same role as a sensor in control engineering collecting physical data from the external environment and delivering it to the system, serving as the standard for defining the initial state of the task at hand. Second, based on the received data, the Thought stage proceeds, where plans are established through logical reasoning within the LLM architecture. This is in line with the process where control algorithms in an ECU calculate optimal control values by processing input sensor data. At this stage, the agent sets the optimal path to achieve the goal and secures the logical rigor of the system. Third, the Action stage follows, where tasks are completed by calling external tools or APIs according to the established plan. This logically matches the mechanism where the calculation results of a control system are converted into physical power through an actuator to execute commands. Through this, intelligence exerts actual physical and digital influence beyond abstraction. Finally, the Observation stage is performed, analyzing the execution results and correcting errors relative to the initial goal. This is identical to the core principle of control engineering, which reduces system deviation through a feedback loop. The agent self-verifies whether the execution results meet the goal and continuously upgrades performance by reflecting occurred errors into the next action plan. AI equipped with such a closed-loop structure is no longer an incomplete system dependent on probability. By securing engineering rigor that self-verifies execution results and corrects errors, it functions as a trust-based partner capable of performing business-critical tasks. 4. Practical Application and Expansion: Software-Defined Vehicles (SDV) and Physical AI The final destination of AI architecture lies in the cross-industry proliferation of Software-Defined Vehicles (SDV) and Physical AI, which overcome and evolve physical constraints through software intelligence. This is the standard model for future System Integration (SI) across manufacturing and service industries. Securing Edge Intelligence and Data Sovereignty: Small models (SLMs) mounted on-device in vehicles or facilities learn real-time field data immediately. This minimizes cloud dependency, perfectly protecting data sovereignty—a core asset of the company—and enables precision services based on ultra-low latency. Hardware Optimization and Lightweight Engineering: To implement the best intelligence within limited power and computational resources, we actively introduce model compression technologies such as Quantization, Pruning, and Knowledge Distillation. Model deployment considering hardware bandwidth becomes a core competency that determines system response speed and user experience. Hybrid Orchestration: We design an integrated architecture that organically connects "Cloud LLMs" possessing broad general knowledge with "Edge SLMs" specialized for specific physical control and security. Integration from a full-stack perspective, penetrating from silicon chipsets to software stacks, provides a powerful competitive advantage that evolves the entire system through software updates alone. 5. Conclusion: The Role and Vision of the AI Architect The ultimate goal of this masterclass is to elevate students from the position of a "User" who passively relies on technology and hopes for luck, to a professional "AI Architect" who perfectly controls and tunes everything from the physical limits of the system to the depths of the software architecture. While the phenomenon of intelligence manifests from software logic, it is silicon (hardware) that defines the physical limits of that intelligence, and only sophisticated engineering can overcome those limits to complete actual business value. "Intelligence may reside in the realm of probability, but the vessel that contains that intelligence and makes it operate according to purpose must belong solely to the realm of rigorous and sophisticated engineering."

This course teaches Python-based text mining: basic theory and practice. It covers fundamental text mining data analysis for practical or thesis writing.

What do you learn in the 'Management Information Visualization Professional' certification course? This certification course focuses on developing the ability to analyze data effectively, visualize it for easy understanding, and communicate necessary information clearly and efficiently for important decision-making within companies or organizations. In simple terms, it is a process of learning the skills to not just look at data, but to uncover hidden meanings within it and express them through charts, tables, and graphs so they can be easily explained to others. Through this course, you will: Develop the power of strategic thinking through data, build practical skills that can be applied immediately to real-world tasks, and enhance your professional expertise and competitiveness. Through this lecture, cultivate the ability to connect management with data and take a step forward as an expert who understands and explains data.

Uncover true value in the age of data! 📊 Designing applications focused on data has now become essential. Develop the insight and skills your company wants with the latest trends and practical case studies. Start now with efficient data processing and design secrets! Your next step, leap into the data-driven world!

It covers basic data concepts, useful R functions and packages, and data analysis exercises, to allow anyone to perform big data analysis using R programming.

We will explain ElasticSearch, LogStash, and Kibana from the basics. In the final step, you will find yourself using the ELK stack to analyze world population and stocks.