강의

챌린지

멘토링

로드맵

커뮤니티

The Easiest Way to Learn Kafka, Taught by a Kakao Interviewer

Build a Kafka cluster with Spring Boot 3.x + Kotlin, and develop a scalable order processing system capable of real-time event streaming using PostgreSQL CDC, Debezium Connect, and Apache Avro schemas.

(4.8) 48 reviews

720 learners

Level Beginner

Course period Unlimited

Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka
Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka

Reviews from Early Learners

4.8

5.0

devHand

89% enrolled

You shouldn't say you know Kafka until you can explain the content in this course to others. This seems like a really helpful course. I had only used simple Producer & Consumer before, but I had no idea there were so many endless ways to utilize Kafka. Even a 15-year veteran at work said they hadn't tried these topics in practice... Whether you're a junior or senior developer, you absolutely must take this course - it's really such a great topic. If there's a realistic downside, it would be nice to have more code that utilizes Kafka at the client level. Since this is a course focused on Kafka, this part seems lacking, and it would be better if someone who already knows Kafka to some extent takes it. As mentioned in the course itself, there are parts that aren't covered in great detail, and those parts can be important from a development perspective, but aside from that, this is really such an excellent course. Thank you for creating such a great course.

5.0

유쾌한 캥거루

96% enrolled

This lecture is structured with a more definitive focus on Kafka rather than being centered on Java & Spring. Honestly, being able to learn about such diverse applications and materials regarding Kafka at this price feels like a great deal. Of course, it seems a bit lacking in terms of client-level content, but since you consistently mentioned that the focus was on Kafka, I don't think this will be an issue. Thank you for the great lecture :)

5.0

Choi

33% enrolled

I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

What you will gain after the course

  • An asynchronous messaging system for publishing and consuming large-scale events using Apache Kafka Producers/Consumers

  • A stream processing system that uses Kafka Streams for real-time data filtering, windowed aggregation, and state store management

  • A change data capture system that uses Debezium CDC to capture PostgreSQL database changes in real time

  • A data exchange system supporting type-safe message serialization and schema evolution using Apache Avro Schema

  • Container infrastructure for centrally managing a Kafka cluster, Zookeeper, PostgreSQL, and Debezium Connect using Docker Compose

  • Event-driven business logic utilizing Event-Driven Architecture for real-time fraud detection, high-value order filtering, and sales statistics aggregation

How do you use an event-driven architecture with MSQ?? 🤔

Have you ever heard of 'event-driven architecture using a message queue (Message Queue)'? 🤔


Although it has become a core component of modern backend systems, applying it in practice can feel daunting. How can you process vast amounts of data reliably, connect multiple services flexibly, and improve the scalability of the entire system? You can find the answer through Kafka and Kotlin.

This course is not a boring lecture that simply lists theory; it is a practical guide designed to help you fully master Kafka’s core features by exploring the actual implementation and execution process together. 🚀

Features of this course ⚡

📌It consists of Java, Spring, Spring Boot, Kafka, and Kotlin.

* Learn how to write more concise and reliable code using Kotlin, a modern language, instead of Java.

* Learn how to perfectly integrate Kafka with Spring Boot, the most popular backend framework.

📌 Build a one-click practice environment using Docker Compose.

* Easily set up complex data platform components such as Kafka, Zookeeper, Schema Registry, and Kafka Connect with a single command.

* Save time setting up your development environment and focus solely on developing core logic.

📌 Beyond simple messaging: designing practical data pipelines

* Beyond simply sending and receiving messages, this covers how to manage data schemas and transmit data reliably using Avro and Schema Registry.

* Learn the secret to keeping the entire system running reliably even when the data structure changes.

📌 Real-time data processing and analysis using the Kafka Streams API

* Learn how to transform and aggregate data in real time using Kafka Streams without a separate cluster.

* Learn stateful stream processing techniques through practical examples such as real-time sales statistics and user activity analysis.

📌 Implementing the CDC (Change Data Capture) pattern using Debezium

* Implement the CDC pattern with Debezium to detect database changes in real time and stream them to a Kafka topic.

* Master the core technology for building event-driven architectures by integrating databases with Kafka.

Recommended for those who aspire to be like this

Backend Developer

I only know how to write APIs and work with databases.

Architecture Solutions Engineer

You need to design a project structure and a scalable architecture.

Job seeker

I'm curious about scalable architectures and structures.

The course covers topics like these. 🤔

  1. Producer & Consumer [ Kafka data production and consumption ]

  2. Topic & Partition [ Distributed data storage and parallel processing ]

  3. Avro & Schema Registry [ Reliable data schema management and serialization ]

  4. Kafka Connect & Debezium [ Real-time capture of database changes (CDC) ]

  5. Kafka Streams API [ Real-time data stream processing and analysis ]

  6. Stateful Stream Processing [ Data aggregation using state ]

  7. Interactive Queries [ API for querying real-time data being processed ]

  8. Consumer Group & Rebalancing [ Consumer scaling and failure handling ]

  9. Event-Driven Architecture [ Event-Driven System Design ]

  10. Various example diagrams [ approximately 36 diagrams included ]


Why should I learn Kafka??

It’s simple! Many companies are already adopting event-driven architectures using Kafka, thereby achieving loose coupling.

The person who created this course

  • A developer who started without a computer science background and currently works as a platform backend developer in Pangyo

  • My goal is to teach practical development methods and methodologies, and I am a knowledge sharer who creates courses together with capable people around me rather than alone.

  • A knowledge sharer who, thanks to his active efforts, was interviewed by Inflearn.

People who took this course

  • A computer science major who graduated from a university in Seoul

  • Currently working at Kakao as a backend and data engineer, after working in the primary financial sector.

  • A developer who creates various courses with Hong and contributes to providing practical knowledge and environments.

Things to Note Before Taking the Course

Prerequisite Knowledge and Notes

  • java

    • java 17.0.12 2024-07-16 LTS

  • IDE

    • intelliJ

  • Docker

    • Docker version 28.0.0, build f9ced58158


We run an open chat room to help you prepare for your careers. We look forward to your interest!

Recommended for
these people

Who is this course right for?

  • Backend developers looking to grow from junior to mid-level

  • A developer who wants to gain experience developing real-time services

  • A mid-level developer who wants to grow into a senior developer

  • Job seekers looking to strengthen their portfolios

  • A developer planning a job change by expanding their tech stack

Need to know before starting?

  • Basic knowledge of Spring is preferred.

Hello
This is Hong

Inflearn Verified

Career Verified

10,237

Learners

609

Reviews

175

Answers

4.8

Rating

30

Courses

I started studying development after becoming interested in it while idling at home, and I am currently responsible for platform server development in Pangyo. I am continuing my activities as a knowledge sharer because I want to provide you with the methods I used to study, as well as the various problems and solutions you may encounter in practice.

 

These lectures are not created solely through my own knowledge. There are others who collaborate on every lecture.

 

[Instructor Career]

[Former] Blockchain developer related to Sandbox IP

[Former] Metaverse Backend Developer

[Current] A server developer becoming a veteran in Pangyo

 

[Interview History]

[Other Inquiries]

[Official Site]

More

Curriculum

All

27 lectures ∙ (5hr 5min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

48 reviews

4.8

48 reviews

  • kask814587762님의 프로필 이미지
    kask814587762

    Reviews 6

    ∙

    Average Rating 5.0

    5

    96% enrolled

    I was assigned the role of introducing Kafka to our company, and I feel like I learned a lot through this course. It seems like a perfect course that allows you to experience everything from simple producer-consumer patterns to more diverse use cases.

    • jhong
      Instructor

      Hello Mr. Woo-dang-tang! Introducing Kafka at your company!! This is proof that your service is growing even bigger 😊😊 Congratulations :) As you mentioned, this is a lecture I prepared covering various use cases. I hope it will be very helpful to you. I'll continue to prepare more beneficial lectures in the future. Thank you :)

  • seungsu8848님의 프로필 이미지
    seungsu8848

    Reviews 4

    ∙

    Average Rating 5.0

    5

    89% enrolled

    This is a great lecture for quickly getting an overview of Kafka. It also covers the essential points, so I highly recommend it for those who are not familiar with Kafka.

    • jhong
      Instructor

      Hello Kim Seung-su, thank you for leaving such a positive review. I will continue to work hard to provide you with more interesting and beneficial lectures in the future. Thank you.

  • cchoii님의 프로필 이미지
    cchoii

    Reviews 12

    ∙

    Average Rating 5.0

    5

    33% enrolled

    I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

    • jhong
      Instructor

      Thank you so much for helping me like this again!! You must be so busy 😭😭 I was so grateful that I woke up at 3-4 AM every day this week to film!! Let's continue creating more beneficial lectures together 😊😊

  • jayuffh225008님의 프로필 이미지
    jayuffh225008

    Reviews 23

    ∙

    Average Rating 4.8

    Edited

    2

    93% enrolled

    The lectures are somewhat unkind. I do not recommend this to those who are new to Kafka.

    • jhong
      Instructor

      Hello jayuh22, thank you for your feedback. Kafka is certainly not an easy subject. That's why I wanted to describe things in a way that you could at least grasp conceptually, and you don't necessarily need to understand everything perfectly ㅠ.ㅠ I wanted to share as much as possible in the hope that it might come back to you later when you need it, but it seems like this approach didn't quite work for you... Even as a job seeker, I think it would be helpful for your studies to first review the parts you do understand from what I've shared, and then tackle the more difficult content later. To be honest, understanding Kafka itself can be quite challenging from a job seeker's perspective. It's a combination of various general development theories and patterns... so I imagine the difficulty level must have felt quite high ㅠㅠ I will be more mindful in the future to provide better content.

  • jycforest29dev4675님의 프로필 이미지
    jycforest29dev4675

    Reviews 2

    ∙

    Average Rating 3.5

    3

    37% enrolled

    There's too much code copying, and it doesn't provide detailed explanations of API or method usage, so you have to look everything up yourself. It might be manageable if you have some background knowledge, but I question whether it's appropriate for Kafka beginners.

    • jhong
      Instructor

      Hello jy c, thank you for your feedback. The reason I proceeded with copying was because I thought there was essentially no reason to type everything out one by one. I felt that just writing programming language code didn't have much significant meaning, so I structured it this way. Additionally, I will further review and adjust the lecture difficulty and target audience. Thank you!

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!