Too much content on unimportant structural principles and too many installation setups. The core content is brief... It would be difficult to adapt in the actual workplace

kkgg2541

Beginner's Kafka & Spark Real-time Pipeline Course.
All-in-one: Master concepts to architecture.

hyunjinkim

Realtime Datalake Using Kafka & Spark

실시간

데이터처리

데이터파이프라인

입문

초급

중급이상

아파치 카프카

Kafka

아파치 스파크

Apache Spark

pyspark

data-lake

Data Lake Introduction

Data Lake Architecture Design

Development Environment Setup

AWS Environment Creation

Kafka setup

Creating Kafka Producer

Kafka UI and Monitoring

Kafka Consumer Creation

Spark setup and basics

Spark Cluster Setup

Understanding Spark

Spark SQL

Spark Streaming

Streaming program setup

Dashboard Configuration

Spark Performance Optimization and Troubleshooting

Spark Steaming Master

Availability test

In conclusion