kimsc

This course is a practical Airflow master program designed to help you understand "why Airflow works this way" and enable you to design and debug data pipelines on your own. It covers everything from Apache Airflow's core mechanisms to detailed theory and hands-on practice involving DAGs, Operators, Hooks, Scheduling, Timezones, Idempotency, and Templates.

dooleyz3525

The Complete Guide to Airflow - Part 1

apache-airflow

Data Engineering

데이터 엔지니어링

datapipeline

입문

초급

중급이상

airflow

orchestration

Course Introduction and Lab Environment Setup

Airflow Fundamental - DAG, Task, Dependency, XCom

Airflow Fundamental - TaskFlow API, retries, Clear, Context, Serialization

Handling Operators and Hooks - Bash, HTTP

Handling Operators and Hooks - SQL (MySQL, PostgreSQL)

Handling Operators and Hooks - S3 (MinIO)

Scheduling - Interval-based, Timezone, Idempotency Design

Scheduling - catchup, backfill, Cron, Timetable, Point-in-Time based

Templating

In closing...