Learning Kafka the Easiest Way, Taught by a Kakao Interviewer

Build a scalable real-time event streaming order processing system using Spring Boot 3.x + Kotlin, establishing a Kafka cluster, and leveraging PostgreSQL CDC, Debezium Connect, and Apache Avro schemas.

(4.9) 38 reviews

608 learners

Level Beginner

Course period Unlimited

Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka
Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka

Reviews from Early Learners

Reviews from Early Learners

4.9

5.0

devHand

89% enrolled

You shouldn't say you know Kafka until you can explain the content in this course to others. This seems like a really helpful course. I had only used simple Producer & Consumer before, but I had no idea there were so many endless ways to utilize Kafka. Even a 15-year veteran at work said they hadn't tried these topics in practice... Whether you're a junior or senior developer, you absolutely must take this course - it's really such a great topic. If there's a realistic downside, it would be nice to have more code that utilizes Kafka at the client level. Since this is a course focused on Kafka, this part seems lacking, and it would be better if someone who already knows Kafka to some extent takes it. As mentioned in the course itself, there are parts that aren't covered in great detail, and those parts can be important from a development perspective, but aside from that, this is really such an excellent course. Thank you for creating such a great course.

5.0

유쾌한 캥거루

96% enrolled

This lecture is structured with a more definitive focus on Kafka rather than being centered on Java & Spring. Honestly, being able to learn about such diverse applications and materials regarding Kafka at this price feels like a great deal. Of course, it seems a bit lacking in terms of client-level content, but since you consistently mentioned that the focus was on Kafka, I don't think this will be an issue. Thank you for the great lecture :)

5.0

Choi

33% enrolled

I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

What you will gain after the course

  • An asynchronous messaging system that publishes and consumes large-scale events using Apache Kafka Producer/Consumer.

  • A stream processing system that utilizes Kafka Streams for real-time data filtering, windowed aggregation, and state store management.

  • A change data capture system that captures PostgreSQL database changes in real time using Debezium CDC

  • A data exchange system that supports type-safe message serialization and schema evolution using Apache Avro Schema.

  • A container infrastructure that integrates and manages a Kafka cluster, Zookeeper, PostgreSQL, and Debezium Connect using Docker Compose.

  • Event-driven business logic that utilizes Event-Driven Architecture for real-time fraud detection, high-value order filtering, and sales statistics aggregation.

How do we use an event-driven architecture utilizing MSQ?? 🤔

Have you ever heard of 'Event-Driven Architecture using Message Queues'? 🤔


It has become a core component of modern backend systems, but applying it to real-world projects can feel overwhelming. The way to reliably process massive amounts of data, flexibly connect multiple services, and increase the scalability of your entire system! You can find the answer right here through Kafka and Kotlin.

I have prepared this course not as a boring lecture that merely lists theories, but as a practical guide to perfectly mastering the core features of Kafka by exploring the actual implementation and operation process together. 🚀

Key Features of This Course

📌It consists of Java, Spring, Spring Boot, Kafka, and Kotlin.

* Learn how to write more concise and stable code using the modern language Kotlin instead of Java.

* Learn the know-how to perfectly integrate Kafka with Spring Boot, the most popular backend framework.

📌 Building a one-click practice environment using Docker Compose.

* Easily build complex data platform components such as Kafka, Zookeeper, Schema Registry, and Kafka Connect with a single command.

* You can save time on setting up the development environment and focus solely on developing core logic.

📌 Beyond simple messaging, designing practical data pipelines

* It goes beyond simply sending and receiving messages, covering how to manage data schemas and transmit data reliably using Avro and Schema Registry.

* Learn the secret to keeping the entire system running stably even when data structures change.

📌 Real-time Data Processing and Analysis Using Kafka Streams API

* Learn how to use Kafka Streams to transform and aggregate data in real-time without a separate cluster.

* Learn stateful stream processing techniques through practical examples such as real-time sales statistics and user activity analysis.

📌 Implementing CDC (Change Data Capture) Patterns Using Debezium

* Implement the CDC pattern using Debezium to detect database changes in real-time and stream them to Kafka topics.

* Master the core technologies for building event-driven architectures by integrating databases with Kafka.

Recommended for these types of people

Backend Developer

I only know how to write APIs and handle databases.

Architecture Solutions Engineer

I need to design the project structure and a scalable architecture.

Job seeker

I'm curious about scalable architecture and structure.

The lecture covers the following topics. 🤔

  1. Producer & Consumer [ Kafka Data Publishing and Subscription ]

  2. Topic & Partition [ Distributed Data Storage and Parallel Processing ]

  3. Avro & Schema Registry [ Stable data schema management and serialization ]

  4. Kafka Connect & Debezium [ Real-time Change Data Capture (CDC) ]

  5. Kafka Streams API [ Real-time data stream processing and analysis ]

  6. Stateful Stream Processing [ Data aggregation using state ]

  7. Interactive Queries [ API for querying real-time data being processed ]

  8. Consumer Group & Rebalancing [ Consumer Scaling and Fault Tolerance ]

  9. Event-Driven Architecture [ Event-Based System Design ]

  10. Various example diagrams [ Includes approximately 36 diagrams ]


Why should I learn Kafka??

It's simple! Many companies are already adopting event-driven architectures using Kafka, thereby implementing loose coupling.

The person who created this course

  • A developer who started as a non-major and is currently working as a platform backend developer in Pangyo.

  • My goal is to teach realistic development methods and theories, and I am a knowledge sharer who creates courses not alone, but together with talented colleagues.

  • A knowledge sharer who conducted an interview with Inflearn thanks to active contributions.

People who participated in this lecture

  • A computer science major who graduated from a university in Seoul

  • A developer who worked in the primary financial sector and is currently developing as a backend and data engineer at Kakao

  • A developer who is contributing to creating various lectures with Hong and providing realistic knowledge and environments.

Notes before taking the course

Prerequisite Knowledge and Precautions

  • java

    • java 17.0.12 2024-07-16 LTS

  • IDE

    • intelliJ

  • Docker

    • Docker version 28.0.0, build f9ced58158


We are running an open chat room to help you prepare for your career. We look forward to your interest!

Recommended for
these people

Who is this course right for?

  • Backend developer seeking growth from junior to mid-level

  • A developer who wants to gain experience in real-time service development

  • A mid-level developer who wants to grow into a senior developer

  • Job seekers who want to strengthen their portfolios

  • A developer planning to change jobs by expanding their tech stack

Need to know before starting?

  • It is helpful to have a basic knowledge of Spring.

Hello
This is Hong

7,498

Learners

461

Reviews

142

Answers

4.7

Rating

25

Courses

Introduction

I started studying development after finding an interest in it while idling at home, and I am currently in charge of platform server development in Pangyo. I am continuing my activities as a knowledge sharer because I want to provide you with the methods I used to study, as well as the various problems and solutions you may encounter in practice.

 

These lectures are not created solely through my own knowledge. Every lecture is made together with others.

 

Instructor Experience

[Former] Blockchain developer related to Sandbox IP

[Former] Metaverse Backend Developer

[Current] A veteran server developer in Pangyo

 

Interview History

Other Inquiries

  • unduck2022@gmail.com

More

Curriculum

All

27 lectures ∙ (5hr 5min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

38 reviews

4.9

38 reviews

  • cchoii님의 프로필 이미지
    cchoii

    Reviews 12

    Average Rating 5.0

    5

    33% enrolled

    I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

    • jhong
      Instructor

      Thank you so much for helping me like this again!! You must be so busy 😭😭 I was so grateful that I woke up at 3-4 AM every day this week to film!! Let's continue creating more beneficial lectures together 😊😊

  • eightee724277님의 프로필 이미지
    eightee724277

    Reviews 6

    Average Rating 5.0

    5

    96% enrolled

    As the title suggests, I think this is a great course that allows you to learn about Kafka really easily and quickly. You can learn everything from general concepts to practical applications, and in a short time, I really got a clear understanding of what Kafka is. Thank you.

    • jhong
      Instructor

      Hello, number 8! Thank you for liking it!! Thank you for leaving such a good review. 😆 I will work hard to provide you with even better lectures in the future. Have a great day :)

  • jukas5985 [DEL] 250815201525님의 프로필 이미지
    jukas5985 [DEL] 250815201525

    Reviews 14

    Average Rating 4.9

    5

    96% enrolled

    This lecture is structured with a more definitive focus on Kafka rather than being centered on Java & Spring. Honestly, being able to learn about such diverse applications and materials regarding Kafka at this price feels like a great deal. Of course, it seems a bit lacking in terms of client-level content, but since you consistently mentioned that the focus was on Kafka, I don't think this will be an issue. Thank you for the great lecture :)

    • jhong
      Instructor

      Hello gohans, thank you for leaving a review. As you mentioned, this course focused on Kafka's various features and concepts rather than the client side. Actual clients would be composed of more complex business logic. So I would appreciate it if you could understand this course as providing direction for studying Kafka 😊 Have a great day!!

  • kask814587762님의 프로필 이미지
    kask814587762

    Reviews 3

    Average Rating 5.0

    5

    96% enrolled

    I was assigned the role of introducing Kafka to our company, and I feel like I learned a lot through this course. It seems like a perfect course that allows you to experience everything from simple producer-consumer patterns to more diverse use cases.

    • jhong
      Instructor

      Hello Mr. Woo-dang-tang! Introducing Kafka at your company!! This is proof that your service is growing even bigger 😊😊 Congratulations :) As you mentioned, this is a lecture I prepared covering various use cases. I hope it will be very helpful to you. I'll continue to prepare more beneficial lectures in the future. Thank you :)

  • kju626095386님의 프로필 이미지
    kju626095386

    Reviews 8

    Average Rating 5.0

    5

    93% enrolled

    Rather than just implementing features, this seems like a lecture that can give you a really broad perspective on Kafka itself. While it covers general Kafka learning topics, it also addresses aspects like architecture, so it feels like it broadens your overall perspective. Thank you for the great lecture.

    • jhong
      Instructor

      Hello! Thank you, ju, for leaving a review. I will work hard to create even better lectures in the future!! Please take care of your health in this hot weather :)

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

$53.90