01. Core Concepts and Infrastructure Setup
Understand the core concepts of Kafka, Hadoop, Spark, and Airflow, and directly build their execution environments and infrastructure.
From the core concepts and infrastructure setup of Kafka, Hadoop, Spark, and Airflow to hands-on practice with Java and Python, as well as building production-level pipelines in an AWS environment.
4 learners are taking this course
Level Beginner
Course period Unlimited
Core concepts of Kafka, Hadoop, Spark, and Airflow
Data Pipeline Infrastructure Setup Practice
Building an operational data pipeline using AWS’s MSK, EMR, MWAA, and S3 services
In this course, you will learn the core concepts and infrastructure setup of Kafka, Hadoop, Spark, and Airflow, complete hands-on exercises using Java and Python, and build production-level pipelines in an AWS environment.
Understand the core concepts of Kafka, Hadoop, Spark, and Airflow, and directly build their execution environments and infrastructure.
Conduct hands-on exercises to understand the characteristics of each technology based on Java, SpringBoot, and Python code.
Build a practical pipeline that can be used for data lakes, log data repositories, big data storage, and pipelines.
Build production-grade pipeline infrastructure using AWS services such as MSK, EMR, MWAA, and S3.
Real-time and batch data processing architecture flow assuming an actual production environment
Data engineers or infrastructure engineers who need to build data pipelines
Backend developer who needs to use Kafka, Spark, and other tools
An AI engineer who needs to build a data lake for AI training
Who is this course right for?
A data engineer who needs to build a data pipeline
Backend developer who needs to use Kafka, Spark, and other tools
An AI engineer who needs to build a data lake for AI training
Inflearn Verified
Career Verified
3,923
Learners
414
Reviews
137
Answers
4.9
Rating
13
Courses
💪💪💪An expert with both practical and teaching experience 💪💪💪
Hello, I'm Seonguk Kim. I graduated from Yonsei University and have worked as a software engineer at major corporations and startups. Currently, I am working as a full-time instructor for corporate training and bootcamps. As an instructor with both practical and teaching experience, I will deliver essential knowledge in an easy-to-understand manner.
Profile : https://www.linkedin.com/in/seongukkim
Corporate training inquiries: ksg39412@naver.com
All
19 lectures ∙ (7hr 27min)
Check out other courses by the instructor!
Explore other courses in the same field!
Limited time deal
$38,500.00
30%
$42.90