paulmoon008308

Learn the process of building data pipelines using Apache Airflow from basics to practical application. Understand Airflow's core concepts and architecture, and master advanced design patterns frequently used in practice such as dynamic DAGs, parallel processing, distributed processing, and Custom Operators through hands-on exercises. Set up a practice environment with Python and Docker, and develop practical skills to design and operate real workflows.

jhong

Designing Large-Scale Data Processing Patterns Based on Data Workflow Management with Toss Developers

실습 중심

자격증

시험

데이터분석

데이터베이스

Hong

입문

초급

중급이상

Big Data

도커

Docker

docker-compose

airflow

Course Introduction and Course Materials

Why We Want to Build a Data Pipeline?

Airflow Core Components And Architecture

DAG & Task Advanced Design Patterns

Parallel Processing and Distributed Processing in Airflow and Large-Scale Reprocessing

Python & Docker를 활용한 경량 환경 구축

Hands-on!! Practical Airflow Training

Additional Airflow Practice That You Should Know