kimsc

本講義は、Apache Airflowの核心的なメカニズムからDAG、Operator、Hook、Scheduling、Timezone、冪等性、Templateまで、詳細な理論と実習で構成されています。Airflowが「なぜこのように動作するのか」を理解し、自らデータパイプラインを設計・デバッグできるようになることを目指す、実践中心のAirflowマスターコースです。

dooleyz3525

Airflow完全ガイド - Part 1

素敵な受講評ありがとうございます ^^

apache-airflow

Data Engineering

데이터 엔지니어링

datapipeline

This course is a practical Airflow master program designed to help you understand "why Airflow works this way" and enable you to design and debug data pipelines on your own. It covers everything from Apache Airflow's core mechanisms to detailed theory and hands-on practice involving DAGs, Operators, Hooks, Scheduling, Timezones, Idempotency, and Templates.

입문

초급

중급이상

airflow

orchestration

The Complete Guide to Airflow - Part 1

Course Introduction and Lab Environment Setup

Airflow Fundamental - DAG, Task, Dependency, XCom

Airflow Fundamental - TaskFlow API, retries, Clear, Context, Serialization

Handling Operators and Hooks - Bash, HTTP

Handling Operators and Hooks - SQL (MySQL, PostgreSQL)

Handling Operators and Hooks - S3 (MinIO)

Scheduling - Interval-based, Timezone, Idempotency Design

Scheduling - catchup, backfill, Cron, Timetable, Point-in-Time based

Templating

In closing...