강의

멘토링

커뮤니티

BEST
Programming

/

Back-end

Learn Kafka the Easiest Way with a Kakao Interviewer

Develop a scalable order processing system with real-time event streaming capabilities using Spring Boot 3.x + Kotlin to build a Kafka cluster, leveraging PostgreSQL CDC, Debezium Connect, and Apache Avro schema.

(4.8) 33 reviews

555 learners

Level Beginner

Course period Unlimited

  • Hong
실습 중심
실습 중심
백엔드이해하기
백엔드이해하기
백엔드
백엔드
아키텍처
아키텍처
스프링
스프링
Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka
실습 중심
실습 중심
백엔드이해하기
백엔드이해하기
백엔드
백엔드
아키텍처
아키텍처
스프링
스프링
Java
Java
Spring
Spring
Kotlin
Kotlin
Spring Boot
Spring Boot
Kafka
Kafka

Reviews from Early Learners

Reviews from Early Learners

4.8

5.0

devHand

89% enrolled

You shouldn't say you know Kafka until you can explain the content in this course to others. This seems like a really helpful course. I had only used simple Producer & Consumer before, but I had no idea there were so many endless ways to utilize Kafka. Even a 15-year veteran at work said they hadn't tried these topics in practice... Whether you're a junior or senior developer, you absolutely must take this course - it's really such a great topic. If there's a realistic downside, it would be nice to have more code that utilizes Kafka at the client level. Since this is a course focused on Kafka, this part seems lacking, and it would be better if someone who already knows Kafka to some extent takes it. As mentioned in the course itself, there are parts that aren't covered in great detail, and those parts can be important from a development perspective, but aside from that, this is really such an excellent course. Thank you for creating such a great course.

5.0

유쾌한 캥거루

96% enrolled

This lecture is structured with a more definitive focus on Kafka rather than being centered on Java & Spring. Honestly, being able to learn about such diverse applications and materials regarding Kafka at this price feels like a great deal. Of course, it seems a bit lacking in terms of client-level content, but since you consistently mentioned that the focus was on Kafka, I don't think this will be an issue. Thank you for the great lecture :)

5.0

Choi

33% enrolled

I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

What you will gain after the course

  • Asynchronous messaging system that publishes and consumes high-volume events using Apache Kafka Producer/Consumer

  • A stream processing system that uses Kafka Streams to perform real-time data filtering, window aggregation, and state store management

  • A Change Data Capture system that captures PostgreSQL database changes in real-time using Debezium CDC

  • A data exchange system that supports type-safe message serialization and schema evolution using Apache Avro Schema

  • Container infrastructure that integrates and manages Kafka cluster, Zookeeper, PostgreSQL, and Debezium Connect using Docker Compose

  • Event-driven business logic that performs real-time fraud detection, high-value order filtering, and sales statistics aggregation using Event-Driven Architecture

How do we use event-driven architecture with MSQ?🤔

Have you ever heard of 'Event-Driven Architecture using Message Queues'? 🤔


It has become a core component of modern backend systems, but when you actually try to apply it in practice, it can feel overwhelming. The way to reliably process massive amounts of data, flexibly connect multiple services, and enhance the scalability of the entire system! You can find the answer through Kafka and Kotlin.

This course is not a boring lecture that just lists theories, but a practical guide prepared to completely master Kafka's core features by examining the actual implementation and operation process together. 🚀

Key Features of This Course

📌It consists of Java, Spring, Spring Boot, Kafka, and Kotlin.

* Learn how to write more concise and stable code using the modern language Kotlin instead of Java.

* Learn the know-how to perfectly integrate Kafka with Spring Boot, the most popular backend framework.

📌 We're building a one-click practice environment using Docker Compose.

* Easily set up complex data platform components like Kafka, Zookeeper, Schema Registry, and Kafka Connect with a single command.

* Save time on development environment setup and focus only on core logic development.

📌 Beyond Simple Messaging: Practical Data Pipeline Design

* Beyond simply sending and receiving messages, learn how to manage data schemas and transmit data reliably using Avro and Schema Registry.

* Learn the secrets to maintaining stable system-wide operations even when data structures change.

📌 Real-time Data Processing and Analysis Using Kafka Streams API

* Learn how to transform and aggregate data in real-time using Kafka Streams without a separate cluster.

* Learn stateful stream processing techniques through practical examples such as real-time sales statistics and user activity analysis.

📌 Implementing CDC (Change Data Capture) Pattern with Debezium

* Implement CDC patterns using Debezium to detect database changes in real-time and stream them to Kafka topics.

* Master the core technology of building event-driven architecture by integrating databases with Kafka.

We recommend this for

Backend Developer

I only know how to write APIs and work with databases

Architecture Solutions Engineer

I need to structure the project and build a scalable architecture

Job seekers

I'm curious about scalable architecture and structure

This course covers the following topics. 🤔

  1. Producer & Consumer [ Kafka Data Publishing and Subscription ]

  2. Topic & Partition [ Distributed Data Storage and Parallel Processing ]

  3. Avro & Schema Registry [ Reliable Data Schema Management and Serialization ]

  4. Kafka Connect & Debezium [ Real-time Database Change Data Capture (CDC) ]

  5. Kafka Streams API [ Real-time Data Stream Processing and Analysis ]

  6. Stateful Stream Processing [ Data Aggregation Using State ]

  7. Interactive Queries [ API for querying real-time data being processed ]

  8. Consumer Group & Rebalancing [ Consumer Scaling and Failure Handling ]

  9. Event-Driven Architecture [ Event-Based System Design ]

  10. Various Example Diagrams [ Includes approximately 36 diagrams ]


Why should I learn Kafka??

It's simple! Many companies are already using Kafka to implement event-driven architectures, achieving loose coupling as a result.

The person who created this course

  • A developer who started as a non-major and is currently working as a platform backend developer in Pangyo

  • The goal is to teach realistic development methods and development theories, and a knowledge sharer who creates courses together with capable acquaintances rather than alone

  • A knowledge sharer who has been featured in an interview on Inflearn thanks to active contributions

People who participated in this course

  • A computer science major who studied at a university in Seoul

  • A developer who worked at a first-tier financial institution and is currently working as a backend and data engineer at Kakao

  • A developer who creates various courses with Hong and contributes to providing practical knowledge and environments

Things to note before taking the course

Prerequisites and Important Notes

  • java

    • java 17.0.12 2024-07-16 LTS

  • IDE

    • IntelliJ

  • Docker

    • Docker version 28.0.0, build f9ced58158


Courses that multiply your learning effectiveness by 10 when taken together

Learn MySQL from a Toss Developer Who Processes Over 500 Billion Financial Data Records [ By. Non-CS Major & Toss Developer ]

  • This course comprehensively teaches you how to efficiently utilize the Database that is essential when using Kafka, and expands your knowledge through an architecture that integrates Kafka!

Recommended for
these people

Who is this course right for?

  • Backend developer seeking growth from Junior to Mid-level

  • A developer who wants to gain experience in real-time service development

  • A mid-level developer who wants to grow into a senior developer

  • Job seekers who want to strengthen their portfolio

  • A developer planning a career change through expanding their tech stack

Need to know before starting?

  • It would be good to have basic knowledge of Spring.

Hello
This is

5,928

Learners

390

Reviews

127

Answers

4.7

Rating

22

Courses

자기 소개

집에서 빈둥대다 개발에 흥미를 느껴 개발 공부를 시작하였고 현재는 판교에서 플랫폼 서버 개발을 담당하여 진행하고 있습니다. 제가 공부를 했던 방법과 실무에서 접하실 수 있는 여러가지 문제점들과 해결책을 여러분들에게 제공하고 싶어 지식공유자 활동을 이어나가고 있습니다.

 

강의는 오로지 저만의 지식을 통해 만들어지지 않습니다. 모든 강의는 함께하시는 분들이 계십니다.

 

지식공유자 경력

[前] 샌드박스IP 관련 블록체인 개발자

[前] 메타버스 백엔드 개발자

[] 판교에서 고여가는 서버 개발자

 

인터뷰 이력

기타 문의

  • unduck2022@gmail.com

Curriculum

All

27 lectures ∙ (5hr 5min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

33 reviews

4.8

33 reviews

  • cchoii님의 프로필 이미지
    cchoii

    Reviews 11

    Average Rating 5.0

    5

    33% enrolled

    I'm filming a lecture and have quite a significant stake in?? I'm a developer working at Kakao!! I also use Kafka a lot in practice!! If it actually reaches production level, it becomes quite complex and realistically there are some parts that this lecture alone cannot cover 😭😭 However, as I mentioned in the course introduction video, I would appreciate it if you could understand that I filmed this based on what information would be good to deliver to junior developers and new developers!! So I focused on filming study direction and a general introduction to Kafka along with hands-on implementation. - For example, in practice, there are parts like offset commit conditions and event consumption failure prevention patterns like DLQ!! Still, I've structured the lecture to be as helpful as possible, so I hope you can learn about Kafka through this course in the easiest, deepest, and fastest way. Please show a lot of interest! Thank you!!

    • jhong
      Instructor

      Thank you so much for helping me like this again!! You must be so busy 😭😭 I was so grateful that I woke up at 3-4 AM every day this week to film!! Let's continue creating more beneficial lectures together 😊😊

  • kask814587762님의 프로필 이미지
    kask814587762

    Reviews 3

    Average Rating 5.0

    5

    96% enrolled

    I was assigned the role of introducing Kafka to our company, and I feel like I learned a lot through this course. It seems like a perfect course that allows you to experience everything from simple producer-consumer patterns to more diverse use cases.

    • jhong
      Instructor

      Hello Mr. Woo-dang-tang! Introducing Kafka at your company!! This is proof that your service is growing even bigger 😊😊 Congratulations :) As you mentioned, this is a lecture I prepared covering various use cases. I hope it will be very helpful to you. I'll continue to prepare more beneficial lectures in the future. Thank you :)

  • eightee724277님의 프로필 이미지
    eightee724277

    Reviews 6

    Average Rating 5.0

    5

    96% enrolled

    As the title suggests, I think this is a great course that allows you to learn about Kafka really easily and quickly. You can learn everything from general concepts to practical applications, and in a short time, I really got a clear understanding of what Kafka is. Thank you.

    • jhong
      Instructor

      Hello, number 8! Thank you for liking it!! Thank you for leaving such a good review. 😆 I will work hard to provide you with even better lectures in the future. Have a great day :)

  • kju626095386님의 프로필 이미지
    kju626095386

    Reviews 8

    Average Rating 5.0

    5

    93% enrolled

    Rather than just implementing features, this seems like a lecture that can give you a really broad perspective on Kafka itself. While it covers general Kafka learning topics, it also addresses aspects like architecture, so it feels like it broadens your overall perspective. Thank you for the great lecture.

    • jhong
      Instructor

      Hello! Thank you, ju, for leaving a review. I will work hard to create even better lectures in the future!! Please take care of your health in this hot weather :)

  • jukas5985 [DEL] 250815201525님의 프로필 이미지
    jukas5985 [DEL] 250815201525

    Reviews 14

    Average Rating 4.9

    5

    96% enrolled

    This lecture is structured with a more definitive focus on Kafka rather than being centered on Java & Spring. Honestly, being able to learn about such diverse applications and materials regarding Kafka at this price feels like a great deal. Of course, it seems a bit lacking in terms of client-level content, but since you consistently mentioned that the focus was on Kafka, I don't think this will be an issue. Thank you for the great lecture :)

    • jhong
      Instructor

      Hello gohans, thank you for leaving a review. As you mentioned, this course focused on Kafka's various features and concepts rather than the client side. Actual clients would be composed of more complex business logic. So I would appreciate it if you could understand this course as providing direction for studying Kafka 😊 Have a great day!!

$53.90

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!