강의

멘토링

로드맵

BEST
Data Science

/

Data Engineering

Kafka Complete Guide - Core

From the core of Kafka to in-depth content on internal mechanisms, the course is structured so that even beginners can quickly reach the expert level through detailed theoretical explanations, hands-on practice, and practical Kafka application development practice.

(4.9) 94 reviews

1,800 learners

  • dooleyz3525
Kafka
Data Engineering

Reviews from Early Learners

What you will learn!

  • Understanding Kafka's core architecture and key components

  • Understanding Kafka's internal core mechanisms

  • Practice operating Kafka with various Kafka commands based on CLI

  • Implement various functions of Producer and Consumer directly using Java

  • Understanding Kafka's internal mechanisms and key environment parameters through hands-on practice

  • Implementing a practical Kafka application using Producer and Consumer

  • Hands-on and understanding of replication and availability architecture in a multi-broker Kafka cluster

  • Practice and understand the startup mechanism of Zookeeper and Kafka and the leader election process of the controller

  • Monitoring Kafka with UI using Confluent Control Center

  • Serialization/Deserialization of custom objects

Distributed streaming platforms, Kafka is the trend!
Learn it thoroughly, starting from the core.

For large-scale data processing
Representative solution, Kafka!

Kafka is the answer to building event streaming applications that handle increasingly massive data processing and complex business requirements.

Kafka, a messaging system, has become an indispensable choice for collecting large amounts of streaming data, building large-scale data pipelines, and building event-driven microservice architectures (MSAs). Consequently, many companies have been rushing to adopt Kafka in recent years, and the demand for Kafka experts is steadily increasing.

Why Kafka?

great
Performance & Availability

forcible
Scalability

formidable
open source ecosystem

distinguished
Mission Stability

Wide
User Community

rich
Online Resources

This course will not only provide a theoretical explanation of Kafka, but will also provide detailed explanations of the internal workings of its core mechanisms, hands-on practice, and implementation of real-world Kafka application development to help you become a Kafka operation and development expert .


Of course the essentials
High level skills are OK.

'Kafka Complete Guide - Core Edition'

Kafka
First time

Kafka skills
Those who want to improve

Theory and Practice
Anyone who wants to take care of everything

This course is designed for those who are learning Kafka for the first time, as well as those who are already applying Kafka to their work but want to build a more solid foundation and improve their skills at a higher level.

  • Core mechanisms of Kafka's main components
  • Hands-on Kafka training using CLI commands
  • Implementing various functions of Producer and Consumer using Java-based Kafka client library
  • Understanding and practicing the high-level internal mechanisms of Kafka's core elements.
  • Implementing a Real-World Kafka Application
  • UI practice for operating and monitoring Kafka using Confluent Control Center
  • Serialization/deserialization of custom objects

It consists of contents such as etc., and you will be able to learn everything from the essential elements required for operating and developing Kafka to the more advanced core mechanisms through this lecture.

Key concepts and practice all in one

The course consists of 30% theory and 70% practice, and the curriculum is filled with various practical classes to help students learn the theory more naturally through practice.

Most of the hands-on classes are conducted through live coding . By following the videos step-by-step, you'll soon find yourself confidently handling Kafka from development to operations.

💡 Please note before taking the class!

  • This course does not cover Kafka connectors or Kafka Streams/KSQ separately. These topics will be covered in a future series of lectures.

Unique features of this course
Check it out.

Intuitive understanding of core mechanisms through illustrations and animations

You can visually understand the core mechanism operation process.

To help you intuitively understand the core mechanisms of Kafka, including brokers, topics, partitions, consumers, replication, and Zookeeper, we have organized the theoretical lectures with numerous illustrations and PPT animations.

Detailed explanation and practice of Kafka's internal deep learning mechanisms and various environment parameters.

In theory, theory and practice are the same. In practice, they are not.
In principle, theory and reality are the same, but in practice, they are quite different. (Albert Einstein)

This lecture goes beyond a conceptual understanding of Kafka's key components and delves into the essential elements of Kafka's internal mechanisms, along with the core environment parameters of Broker, Producer, and Consumer, at a level never before seen in any other lecture.

Additionally, the lectures are structured in a sequence that begins with an explanation of the internal mechanism theory and then moves on to practical training, which will allow you to more firmly master what you have learned in theory.

From basic to practical level, various Java-based practice codes are explained in detail line by line.

Most of the hands-on training will be conducted through live coding. For any potentially challenging code, I'll provide detailed, line-by-line explanations. Beyond basic Kafka producer and consumer client code, you'll learn to implement challenging, real-world Kafka applications alongside me, further enhancing your skills.

Practice is the only way to learn! Learn by repeating the code.
We also provide a PDF of the lecture materials, which are over 200 pages long.

Practice Environment 💾

Server OS

The Kafka server OS is Ubuntu Linux 20.04, running on an Oracle VirtualBox VM. Although it uses Linux, it runs on a virtual machine, making it suitable for both Windows and macOS environments.

VirtualBox can be installed on most Windows and macOS platforms. However, for Macs, VirtualBox is not installed on the latest M1 models. Therefore, you must install Ubuntu using a virtual environment such as UTM. For M1 models, please ensure that Ubuntu can be installed in a virtual environment before selecting a course.

Confluent Kafka
Community Edition

Kafka uses Confluent Kafka Community Edition version 7.1.2, not Apache Kafka.

Confluent, founded by the core team behind Kafka, provides enterprise-grade Kafka with enhanced performance and convenience for enterprise customers. It offers 100% compatibility with Apache Kafka while also offering access to a wider range of Kafka modules and integrated binaries. With Confluent, you can leverage the powerful distributed Kafka system in a more elastic and scalable form. This reduces infrastructure deployment and maintenance burden and accelerates development.

Client Development

Kafka client development is Java- based, using IntelliJ IDEA . Kafka offers client libraries for various languages, but the Java-based client is the most widely supported, offering performance, stability, and the latest features.

Recommended PC Specifications

A full lab environment configuration may require a PC environment with 20-30GB of storage capacity and 4GB or more of RAM .


Check out the Q&A 💬

Q. Why should I learn Kafka?

Kafka has established itself as a leading solution for real-time, high-capacity event streams platforms. Thousands of companies worldwide use Kafka due to its high message processing performance and reliability, diverse feature support, and large ecosystem and community. It is used for a wide range of purposes, from building data pipelines to microservices.

Therefore, many companies are currently seeing a growing demand for Kafka-savvy individuals. This demand will only continue to grow, so mastering Kafka will be a significant advantage for your career.

Q. Can I take the course even if I don't know Kafka?

Yes, this course is structured step-by-step, from basic to advanced, so even beginners can easily follow along. By slowly following the numerous hands-on, live-coding sessions, even beginners will soon become proficient in Kafka.

Q. Can I take the course even if I don't have any Java development experience?

While Kafka knowledge is optional, basic Java programming skills, including an understanding of threads, are required for the practical exercises. The Java code used in the exercises can be found on GitHub .

If you do not have basic Java programming experience , you may have difficulty with the practical exercises. Therefore, please review the practical Java code in advance before taking the course and make sure that it is appropriate for your level.

Q. Is prior knowledge of Linux and IntelliJ required?

Linux and IntelliJ are explained in detail from installation to environment configuration, so you don't need to know them, but it may be more helpful for your practice if you know them.

Q. Will the course also cover Kafka Connect and Kafka Streams/KSQL?

This lecture is the first in a series of Kafka lectures, covering the essential architecture of Kafka. The series consists of three lectures. The second lecture will cover Kafka Connect and Schema Registry, and the third will cover Kafka Streams/KSQL. (The detailed release schedule has not yet been determined.)

Kafka Series!! Great lectures to listen to together 📖

Recommended for
these people

Who is this course right for?

  • For those who want to learn Kafka for the first time

  • Anyone who is using Kafka but wants to gain a more solid foundation of knowledge

  • Anyone who needs a solid understanding of Kafka's Advanced Internal mechanism and key environment parameters

  • For those who want to implement Producer and Consumer functions using Java

  • For those who want to develop Kafka applications closer to real-world situations

  • Data engineers considering adopting Kafka for large-scale data collection and data pipeline construction

  • Solution architects considering implementing a messaging system in their enterprise environment

  • Anyone interested in Kafka's distributed messaging system architecture

Need to know before starting?

  • You don't need to know Kafka, but you need basic Java programming knowledge to understand Threads.

Hello
This is

26,326

Learners

1,323

Reviews

3,983

Answers

4.9

Rating

13

Courses

(전) 엔코아 컨설팅

(전) 한국 오라클

AI 프리랜서 컨설턴트

파이썬 머신러닝 완벽 가이드 저자

Curriculum

All

149 lectures ∙ (22hr 53min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

94 reviews

4.9

94 reviews

  • yebinkang3286님의 프로필 이미지
    yebinkang3286

    Reviews 4

    Average Rating 4.8

    5

    99% enrolled

    本当に良い講義です。 カフカについて基本的な内容を超えて詳細な内部メカニズムを教えてくれる資料がなくて気になりましたがありがとうございます:)

    • dooleyz3525
      Instructor

      素晴らしい賞賛ありがとうございます^^

  • humbledv님의 프로필 이미지
    humbledv

    Reviews 26

    Average Rating 5.0

    5

    100% enrolled

    ノンカフカレガシーの開発者ですが、カフカは要塞がとても流行していて、同僚との雑談に乗るために受講しました。 原理まで説明してくれてとてもお得でした。 ありがとうございます。

    • dooleyz3525
      Instructor

      よく聞かれたなんて、私も嬉しいです。よろしくお願いします。

  • hjj199110565님의 프로필 이미지
    hjj199110565

    Reviews 22

    Average Rating 5.0

    5

    100% enrolled

    離職しようとする会社でカフカを使用しそうで、あらかじめ勉強兼受講したのですが、20時間以上の講義が退屈しないように頑張ることができ、カフカの概念が取れたようです。仕事に適用して使ってみて、復習して活用できるように努力しなければならないようです。ありがとうございます。

    • dooleyz3525
      Instructor

      頑張おめでとうございます。 退屈しないように頑張られたなんて私も嬉しいです。良い受講評価ありがとうございます。

  • palmseung님의 프로필 이미지
    palmseung

    Reviews 4

    Average Rating 5.0

    5

    56% enrolled

    kafkaの使用についての舐めではなく、kafkaの原則を正しく説明しながら教えてくれる講義!

    • dooleyz3525
      Instructor

      コアを貫く受講評、ありがとうございます。

  • bom20065님의 프로필 이미지
    bom20065

    Reviews 2

    Average Rating 5.0

    5

    61% enrolled

    まだ授業は全部聞いていませんが、カフカについて詳しく説明していただき、とても良いです! 良い授業を準備していただきありがとうございます! 次の講義も楽しみになりますㅎㅎ

    • dooleyz3525
      Instructor

      講義が役に立ったなんて私も嬉しいですね。残りの講義もお楽しみください^^

$77.00

dooleyz3525's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!