初心者のための Kafka & Spark リアルタイムパイプライン入門講座。 コアコンセプトからアーキテクチャまでマスターするためのオールインワン講座です。
Github Actionsと AWS Code Deployで CI/CD 実装
Kafka Broker, Confluent Producer & Consumer
Prometheus & Grafana を利用した Kafka Dashboard モニタリング
Catalog 管理のための Spark & Hive Metastore
Spark Streamingを利用した実践プロジェクト実装
Kafka & Spark, Zookeeper & Yarn の 可用性テスト
リアルタイムデータパイプラインを学びたいです。
データパイプラインには興味があるものの、リアルタイム処理は経験したことがない方
DataLakeについて知りたいです。
Cloud上に構築されるDataLakeがどのように実装されるのかを学びたい方
アーキテクトとして成長したいです。
インフラ設計からコードレベルまで大容量処理が可能で堅牢なアーキテクチャ実装が気になる方
学習対象は
誰でしょう？
Kafka & Spark を学びたい方
リアルタイムパイプラインの実装を学びたい方
データエンジニアとして 様々な知識とスキルの開発が必要な方
前提知識、
必要でしょうか？
Pythonの基本概念
SQLに関する基本知識 (Filter, GroupBy, OrderBy程度)
Linux の基本的なコマンドを扱えるレベル
1,064
受講生
54
受講レビュー
185
回答
4.9
講座評価
2
講座
안녕하세요.
데이터 & AI 분야에서 일하고 있는 15년차 현직자입니다.
정보관리기술사를 취득한 이후 지금까지 얻은 지식을 많은 사람들에게 공유하고자 컨텐츠 제작하고 있습니다.
반갑습니다. :)
Contact: hjkim_sun@naver.com
全体
113件 ∙ (28時間 23分)
講座資料（こうぎしりょう）:
全体
11件
4.8
11件の受講レビュー
受講レビュー 17
∙
平均評価 4.9
5
I'm learning so much from the curriculum and content that are organized far better than I expected. I really felt that you put a lot of care into creating this course. I'll be waiting for the follow-up courses. Thank you.
Dear Ramjjibaeng, Thank you for your course review. While creating the curriculum, I also thought a lot about how to teach from the basics solidly while connecting from Kafka to Spark. Thanks to you, it took a year from planning to completing the course, but I'm proud that you recognized it like this ^^ Thank you. The follow-up course I'm preparing now isn't season 2, but I'll proceed with substantial content so you won't regret it 😀
受講レビュー 1
∙
平均評価 5.0
修正済み
5
I trust and watch Teacher Hyeonjin's classes. Highly recommend. I discovered this through the Airflow course, and it has many differentiating factors from other courses. From concepts to architecture design, I liked how you explain the reasons for use and principles. The hands-on practice is comfort itself. You always provide kind answers as well. I'm still in the early stages of taking the course, but I'll complete it all~ The weather is hot, so please take good care of your health.
Hello, yeoksijaneya! Thank you so much for continuing to find me after airflow! When I learn something on my own, if I only learn the superficial usage without understanding the principles, I quickly forget and don't really understand it. I think others are the same way, so I tend to dedicate a lot of lecture time to conveying the principles I've understood. That's why I have to make PPTs and create assignments, which is a bit tough, but I'm grateful that you recognize this effort :) I'll prepare the next lecture well too 💪
受講レビュー 1
∙
平均評価 5.0
修正済み
5
It was a remarkably high-quality lecture.. Simply moving. Usually when taking lectures, you often face situations like 'Why isn't it working when I followed exactly?', and there would be quite a few such cases, but I completed this smoothly without any of that. When choosing a lecture, I first look at the curriculum and compare the price and duration. Until now, there have been many lectures that were too superficial compared to the price, But I guarantee that if you take Hyunjin's kafka&spark lecture, you can produce sufficiently high-quality results in future projects as well! I learned a lot. Thank you! (When do you think Season 2 will be released..?)
Hello, Chan-young! Thank you for your touching review. As you know well after completing the course, I was quite concerned that it might not be easy to follow along, as the content includes a variety of topics from infrastructure setup and nginx configuration to docker setup and availability testing, rather than simply explaining functions. That's why I standardized as much as possible using ansible-playbook, and even after finishing the lecture recording, I followed the lecture myself to check if there were any parts that weren't working correctly. And in case someone had trouble, I even prepared a Discord room for smooth communication. In the end, it took quite a long time to release the lecture, but I tried my best to create a lecture with high completeness. Knowing that Chan-young recognized my efforts makes all the hard work feel like it's washed away ^-^ I am even more grateful.. Also, before starting Season 2, I'm preparing a lecture related to generative AI first, so it might be a bit later. Still, I'll do my best to prepare it!
受講レビュー 2
∙
平均評価 4.0
受講レビュー 3
∙
平均評価 5.0
5
I haven't finished watching all the lectures yet, but just from the AWS environment configuration section, I can already guess the quality of the entire course.. Personally, even if you're not in the data field, this is a lecture that would be quite helpful for those working in architecture as well. I'll work hard to complete the entire course!!
Hello Kim Boin, Yes, this course is not simply about trying out Kafka producing and consuming, or just running Spark once and calling it done. Especially with Kafka & Spark being cluster structures, you cannot write proper code without understanding the principles. To understand the principles, you need to understand cluster structures, and to understand cluster structures, you need to know why you need to configure three nodes, and how the infrastructure should be set up. That's why this is a course that explains and configures everything step by step, starting from the infrastructure. I'm also happy to hear that it was very helpful for learning architecture :) Keep fighting!
￥15,506
知識共有者の他の講座を見てみましょう！
同じ分野の他の講座を見てみましょう！
