Designing Large-Scale Data Processing Patterns Based on Data Workflow Management with Toss Developers

You may have felt frustrated using Redis without being able to explain why it should be designed that way or why certain patterns emerged. Through my experience in both practical development and as an interviewer, I have treated Redis not just as a simple cache, but as a core component that determines service stability and scalability. This course is not about memorizing commands; instead, I will share my experiences on which structures to choose in real traffic environments and their trade-offs, helping you establish the criteria to explain these concepts confidently in both interviews and practical work.

Learn the SAGA transaction management technique for maintaining data consistency in distributed environments through a hands-on approach. You will configure three microservices using Spring Boot and Docker, and implement both Orchestration and Choreography patterns using Kafka and MySQL. Through this course, you will master core concepts applicable to real-world scenarios, including the operational principles of distributed transactions, designing compensating transactions, and handling fault recovery.

This course was created to solve a common problem many people face while preparing for developer jobs: "I studied CS and data structures, but I get tongue-tied during interviews." While conducting actual interviews at companies like Naver, Kakao, and Toss, I noticed that most candidates have memorized concepts but cannot explain why those concepts are necessary or how they are applied in real-world situations. Rather than simple rote memorization, this course teaches you how to understand the interviewer's intent and provide more persuasive answers to the same questions. Whether it's the OSI 7 layers, data structures, or coding tests, we focus on why you need to know them, when they are used, and how to speak about them to receive a positive evaluation in an interview. This course is for those who want to become developers who can explain what they understand in their own words, rather than just giving the same answers as everyone else.

Most developers are still stuck on Batch and CronJobs when it comes to data processing. However, in real-world production environments, data is generated continuously, and failing to process that flow immediately leads to latency, bottlenecks, and consistency issues. Having personally dealt with real-time recommendations, state synchronization, and event delay problems in high-traffic environments, I’ve often asked myself, "Is batch processing really the right approach for this?" This course begins with that very question. It explores how to use Apache Flink to perform computations the moment data flows, manage state securely, and produce accurate results based on Event Time—all from a practical perspective. Beyond simple theoretical explanations, you will experience how real-time stream processing systems are designed and operated through actual source code and architectures. For those who found real-time processing vague or were curious about the world beyond messaging, this course will provide a clear sense of direction.

This course explores microservice architecture and distributed environments not as a simple list of technologies, but from a 'design perspective' required in actual work and interviews. Starting from the differences between monolithic and MSA, it progressively covers incremental migration strategies, modular monoliths, clean architecture and hexagonal architecture, clearly explaining why each choice is necessary and the trade-offs involved. Through hands-on practice, you can directly verify the intent of the structure and learn about core issues inevitably encountered in distributed environments—such as data consistency, transactions, inter-service communication, and failure handling—through realistic scenarios. Based on actual questions and perspectives from Kakao interviewers, this course aims to go beyond simple knowledge acquisition and elevate your way of thinking about distributed systems to the next level.

Learn how to design and handle large-scale data architectures that process hundreds of billions of records using only pure SQL and core MySQL features, alongside a Toss developer who handles hundreds of billions of financial traffic transactions and a developer who started as a non-major and is now developing platforms in Pangyo.

How will you handle exploding traffic? Learn how to build resilient and flexibly scalable architectures through practical EDA (Event-Driven Architecture) design patterns using Kafka, Spring, CDC, and Temporal. A Kakao developer shares real-world experience with clear, easy-to-follow explanations that even non-majors can understand. A practice-oriented course covering everything from real-time data flow and event processing to microservice integration!

This course covers RPC communication techniques that maximize performance in large-scale MSA (Microservice Architecture) environments. Going beyond simple gRPC practice, you'll learn how to implement stable and efficient inter-service communication in real production environments where hundreds of microservices operate simultaneously. Based on Golang, the course covers Protocol Buffers (proto) syntax writing, automatic code generation and service implementation, gRPC structure and advantages over existing RPC, and performance optimization strategies with a practical focus. To ensure easy understanding for non-majors and server development beginners, the course provides step-by-step explanations from RPC concepts to gRPC's internal operating principles, enabling you to develop practical skills that can be immediately applied to real services.

At some point in backend development, you start to have these concerns. It's that moment when services expand and traffic increases, and you begin to feel the limitations of simple REST communication and CRUD structures. I experienced these same issues in the field and went through much trial and error balancing performance and structural complexity. The solution I chose during that process was NATS. Its simple configuration based on a single binary, ultra-low latency performance in microseconds, and the fact that it provides essential features—from Pub/Sub to Queue Groups and JetStream—without being overkill made it a very practical choice for real-world service environments. This course is not just a list of NATS features. Based on the problems I faced in practice, I explain through code and workflows why I chose NATS in certain situations and how I designed the architecture. This course is designed to help everyone—from those new to messaging systems to backend developers preparing for employment and senior developers considering better architectures—understand distributed systems and grow to the next level.

This course covers how to set up multi-module projects from scratch using Kotlin and Spring Boot. It proceeds with a hands-on approach, covering everything from the basic concepts of modularization to Gradle configuration, managing dependencies between modules, and actual application development. If you are a beginner or intermediate developer looking to learn the fundamentals and practical application of multi-modules, please refer to this course.

Develop a scalable real-time WebSocket chat server capable of handling high traffic by building a 3-instance cluster with Spring Boot 3.x and Kotlin, utilizing Redis Pub/Sub for distributed messaging and Nginx as a load balancer.

You can learn how to send emails using AWS and Spring. Through this, you can study how to create an email verification system.

Build a scalable real-time event streaming order processing system using Spring Boot 3.x + Kotlin, establishing a Kafka cluster, and leveraging PostgreSQL CDC, Debezium Connect, and Apache Avro schemas.

This course is a master class that systematically covers the fundamental principles and practical applications of MongoDB. Starting with core MongoDB concepts, you will systematically learn essential topics for practical work, such as database design, CRUD operations, indexing, aggregation pipelines, performance optimization, transactions, and security. It explains topics step-by-step so even beginners can understand, and you can deeply learn the working principles of MongoDB through exercises and examples. This is the best introductory and practical course for developers who want to build strong MongoDB skills for practical work.

Kotlin mastery via virtual payment server course.

This course provides a step-by-step learning path, ranging from the fundamental usage of MySQL to advanced techniques required in real-world production environments. It covers a wide range of topics, including data modeling techniques based on various case studies and practical data, evaluating the effectiveness of Foreign Key designs, analyzing Google Calendar schema DDL, and modern DDL design principles. Through this course, you will gain an in-depth understanding of how to utilize MySQL as a core system component rather than just a simple database.

Learn the process of building essential Observability in a Microservices Architecture (MSA) environment from basics to practical application. Master standardized data collection using OpenTelemetry, trace storage and search through Grafana Tempo, and visualization using TraceQL through step-by-step hands-on practice. You can learn how to track service flows through distributed tracing, identify bottlenecks, and analyze the root causes of failures.

This course is a master class that teaches Kotlin's 🌺 Coroutine, covering everything from theoretical foundations to practical application in a standard manner. It systematically covers core principles and structure, the necessity of asynchronous programming, Coroutine builders and scopes, exception handling, channels, Flow, and other key features frequently used in practice, step by step. Each concept is explained with hands-on examples, making it easy for beginners to understand and immediately apply them. This is the best introductory and practical course for developers who want to build strong Coroutine skills for real-world use.

Let's build a project using Ktor, the most popular project in Kotlin, and master Kotlin! 😆

I am covering the know-how on how I studied and got a job, starting as a non-major.

Most developers are still stuck on Batch and CronJobs when it comes to data processing. However, in real-world production environments, data is generated continuously, and failing to process that flow immediately leads to latency, bottlenecks, and consistency issues. Having personally dealt with real-time recommendations, state synchronization, and event delay problems in high-traffic environments, I’ve often asked myself, "Is batch processing really the right approach for this?" This course begins with that very question. It explores how to use Apache Flink to perform computations the moment data flows, manage state securely, and produce accurate results based on Event Time—all from a practical perspective. Beyond simple theoretical explanations, you will experience how real-time stream processing systems are designed and operated through actual source code and architectures. For those who found real-time processing vague or were curious about the world beyond messaging, this course will provide a clear sense of direction.

At some point in backend development, you start to have these concerns. It's that moment when services expand and traffic increases, and you begin to feel the limitations of simple REST communication and CRUD structures. I experienced these same issues in the field and went through much trial and error balancing performance and structural complexity. The solution I chose during that process was NATS. Its simple configuration based on a single binary, ultra-low latency performance in microseconds, and the fact that it provides essential features—from Pub/Sub to Queue Groups and JetStream—without being overkill made it a very practical choice for real-world service environments. This course is not just a list of NATS features. Based on the problems I faced in practice, I explain through code and workflows why I chose NATS in certain situations and how I designed the architecture. This course is designed to help everyone—from those new to messaging systems to backend developers preparing for employment and senior developers considering better architectures—understand distributed systems and grow to the next level.

You will learn Apache Airflow, the most widely used Orchestrator for creating software data pipelines.

This is a code-lab-oriented course where you will directly build big data or distributed processing system clusters (HDFS, Zookeeper, Spark, Zeppelin) that guarantee High Availability.

How is processing big data different from processing data with Pandas? Let's learn about Spark, an essential framework for big data processing.

This is a special lecture that can lay the theoretical foundation to simultaneously prepare for the Microsoft AZ-900 certification, and as the latest content reflecting the scope of questions as of May 2025, by providing content related to core data concepts, Azure's relational data, Azure's non-relational data, and Azure's analytical workloads in a form combining theory and practice, it can be utilized as a meaningful educational opportunity to not only obtain the certification but also take the first step towards becoming a data professional.

If you work with data, SQL is a fundamental skill you must know. In this course, we will learn SQL from a data analysis perspective, focusing on hands-on practice. The practice will be conducted in Google Colab using DuckDB.

Uncover true value in the age of data! 📊 Designing applications focused on data has now become essential. Develop the insight and skills your company wants with the latest trends and practical case studies. Start now with efficient data processing and design secrets! Your next step, leap into the data-driven world!

Real-time data processing is now essential, not optional! Learn to handle real-time streaming smartly with Apache Flink. Batch? Streaming? Even complex concepts can be understood easily and quickly. Hands-on practice configuration where you'll get the hang of it by directly working with Kafka and DB integration! In a world driven by data, start first with Flink.

Redis is a fast and scalable open-source database. This technology is used to maximize performance in real-time applications, games, social media platforms, and more. However, to truly understand the power of Redis and use it effectively, you need a deep understanding. Now is your chance to learn Redis in a professional way. "Redis with Silicon Valley Engineers" covers a wide range of topics, from the core concepts of Redis to advanced features. This course is designed for everyone, from beginners who are new to Redis to advanced users.

Learn the process of building essential Observability in a Microservices Architecture (MSA) environment from basics to practical application. Master standardized data collection using OpenTelemetry, trace storage and search through Grafana Tempo, and visualization using TraceQL through step-by-step hands-on practice. You can learn how to track service flows through distributed tracing, identify bottlenecks, and analyze the root causes of failures.

It covers basic data concepts, useful R functions and packages, and data analysis exercises, to allow anyone to perform big data analysis using R programming.

I have created an introductory and practical Docker course that is easy for non-majors to understand and can be applied immediately in the real world!

Regardless of the field! This is a lecture that covers the core fundamentals that developers must know in practice in an easy + code-oriented way. I highly recommend this lecture to all junior developers and job seekers who want to grow.

You may have felt frustrated using Redis without being able to explain why it should be designed that way or why certain patterns emerged. Through my experience in both practical development and as an interviewer, I have treated Redis not just as a simple cache, but as a core component that determines service stability and scalability. This course is not about memorizing commands; instead, I will share my experiences on which structures to choose in real traffic environments and their trade-offs, helping you establish the criteria to explain these concepts confidently in both interviews and practical work.

SQLD Yellow Book 176 Problem-Solving Course for those who studied but can't solve problems. After completion, you'll go beyond passing to become an expert. SQLD All-in-One Pass!

In this lecture, you will learn how to create an ERD. You will learn database design. (The only big data design lecture in Korea)

A beginner's guide to SQL coding! We'll teach you the secrets of writing, interpreting, and validating SQL.

A new curriculum that incorporates the experiences of working developers using Docker, providing lectures that are different from existing textbooks and lectures. It starts from the fundamental question of why Docker should be used, rather than simple command usage.

SSIS, SSAS, MachineLearning, BI, ETL. You can learn important technologies that cannot be found in domestic books, YouTube, lectures, blogs, and academies. I also recommend it to those who are interested in employment at domestic large companies, American large companies, and American state funding agencies.