inflearn logo

Introduction to Building Data Pipelines Using Kafka, Hadoop/Spark, and Airflow

From the core concepts and infrastructure setup of Kafka, Hadoop, Spark, and Airflow to hands-on practice with Java and Python, as well as building production-level pipelines in an AWS environment.

(5.0) 2 reviews

44 learners

Level Beginner

Course period Unlimited

Kafka
Kafka
Hadoop
Hadoop
Apache Spark
Apache Spark
airflow
airflow
amazon-msk
amazon-msk
Kafka
Kafka
Hadoop
Hadoop
Apache Spark
Apache Spark
airflow
airflow
amazon-msk
amazon-msk

What you will gain after the course

  • Core concepts of Kafka, Hadoop, Spark, and Airflow

  • Data Pipeline Infrastructure Setup Practice

  • Building an operational data pipeline using AWS’s MSK, EMR, MWAA, and S3 services

Recommended for
these people

Who is this course right for?

  • A data engineer who needs to build a data pipeline

  • Backend developer who needs to use Kafka, Spark, and other tools

  • An AI engineer who needs to build a data lake for AI training

Hello
This is bradkim

Inflearn Verified

Career Verified

4,152

Learners

436

Reviews

140

Answers

4.9

Rating

13

Courses

💪💪💪An expert with both practical and teaching experience 💪💪💪

Hello, I'm Seonguk Kim. I graduated from Yonsei University and have worked as a software engineer at major corporations and startups. Currently, I am working as a full-time instructor for corporate training and bootcamps. As an instructor with both practical and teaching experience, I will deliver essential knowledge in an easy-to-understand manner.

Profile : https://www.linkedin.com/in/seongukkim

Corporate training inquiries: ksg39412@naver.com

More

Reviews

All

2 reviews

5.0

2 reviews

  • cksgnl744190님의 프로필 이미지
    cksgnl744190

    Reviews 28

    ∙

    Average Rating 5.0

    5

    32% enrolled

    • lhs70914100님의 프로필 이미지
      lhs70914100

      Reviews 1

      ∙

      Average Rating 5.0

      5

      63% enrolled

      bradkim's other courses

      Check out other courses by the instructor!

      Similar courses

      Explore other courses in the same field!

      25% off for new members

      $32.90

      25%

      $42.90