BEST

15-day big data pilot project

Name: 15-day big data pilot project
Price: 132000 KRW
Rating: 4.8 (121 reviews)

"Big Data + AI Full Stack Development" - The process of building big data that breathes life into AI is carried out in the form of a pilot project. We identify requirements, configure the platform step by step, and perform smart car data exploration and analysis.

(4.8) 121 reviews

1,174 learners

빅디

Big Data

Hadoop

Kafka

ZooKeeper

Flume

Reviews from Early Learners

What you will gain after the course

Even beginners can complete big data/AI projects by following along.
Understand the analysis > design > development > application process of big data/AI projects
How to use large volumes of data + real-time data for analysis
The process of creating value from big data to AI through the smart car mini project
How to apply open source to your project and structure your architecture

Big Data + AI Learning, Finished in 15 Days!
Make it fun with a practical project.

📣 Please check before taking the class!

This course will configure a virtual machine server environment based on VirtualBox. Please note that Mac M1 and M2 models do not support VirtualBox and therefore cannot be used for practical training. Please check your PC environment before attending.

Core technologies of the 4th Industrial Revolution
Understand both big data and AI!

This course aims to serve as a training tool for overcoming the technological barriers of big data and AI. It focuses particularly on the implementation technologies and operating principles of big data/AI, created by complex distributed software and analytics techniques operating on large-scale infrastructure .

Let's take the example of smart cars , already a common sight in our daily lives. The electronic technology within these smart cars generates a vast amount of data through various IoT sensors that monitor the vehicle and driver's conditions, from mileage to driving patterns, location, and speed. This information is then utilized in various business sectors, including insurance, marketing, advertising, automotive, and transportation, and then relayed back to the driver.

As such, big data technology has become an indispensable element of our lives. However, the sheer volume of data makes big data technology seem daunting and vague. But what if anyone could integrate big data and AI technologies and create value with just a little bit of technical skill?

Seeing the forest and the trees at the same time
Everything about big data systems!

This course identifies the practical requirements needed to build a big data system and explains the core technologies of big data to address them. Following this, through a virtual smart car pilot project, you will gain hands-on experience building and utilizing real-world big data and AI systems.

Anyone is welcome! Go through the four steps of collecting, loading, exploring, and analyzing data to generate insights and value through machine learning/deep learning. Through this course, I hope IT professionals just entering the big data field will gain the insight to see both the forest and the trees simultaneously .

As a smart car pilot project
Easy and fast practical learning.

Through a virtual smart car pilot project, you'll build a real-world big data and AI system by following the four steps of "collect → load → explore → analyze." Through projects leveraging over 20 open source projects and the Hadoop ecosystem, you'll gain a deeper understanding of big data and AI principles and quickly adapt to real-world applications.

As a 15-day pilot project
Concepts and practice at the same time.

The project schedule is 15 days +α in total. It is structured so that you can understand the basic concepts of big data and then follow all the steps of a pilot project required for system construction through hands-on practice.

Who would benefit from learning this?

Big data learning
Students/job seekers who have just started

AI, big data technology
Developers who will apply

Data utilization/analysis
A worried planner

Interested in big data
Anyone OK

Students, job seekers, developers/engineers, analysts, planners, and others preparing for projects using big data and AI technologies, open source, and architecture can tackle the project from start to finish with only basic SW knowledge.

Complex big data + AI environment,
Communication and collaboration skills are becoming increasingly important .

By experiencing the roles and positions of various stakeholders firsthand, we help you quickly adapt to real-world situations and achieve excellent results.

Essential learning environment.

You will need one low or high spec PC below.

🖥️ Please refer to the PC environment related to the practice!

Before starting the practice, it is essential to secure free memory and disk space .
We provide 18GB of practice materials and 2 virtual servers.
Let's configure a virtual machine server environment based on VirtualBox.
Mac M1 and M2 models do not support VirtualBox, so practice is not possible .

The book of the knowledge sharer
If you're curious?

_{Big Data Technology: Practical Learning ( Wikibooks , 2nd edition)}

Big Data Technology : Data Collection, Loading, Processing, Exploration, Analysis, and Machine Learning
(Wikibooks, go directly to the book introduction)

Recommended for
these people

Who is this course right for?

Those who need practical project experience in the big data/AI field
For those who need insight to see both the forest and the trees of big data/AI at the same time
Those who need training tools to overcome the technology barriers of big data/AI
Those who need the ability to utilize open source to grow as an architect

Need to know before starting?

Understand the code print("Hello World!")
Copy & Paste Simple Linux Commands

Hello
This is

1,174

Learners

121

Reviews

375

Answers

4.8

Rating

Course

금융과 통신 등 다양한 분야에서 빅데이터와 AI 관련 전문가로 활동하고 있으며, 기술&경험의 채우기와 비우기를 반복하며 소소한 행복을 찾는 Big.D(빅디) 입니다.

Curriculum

All

128 lectures ∙ (22hr 48min)

Course Materials:

Lecture resources

Section 1. Introduction

2 lectures ∙ (10min)

Section 2. Understanding Big Data

8 lectures ∙ (58min)

3. 1.Big Data Concept
07:54
4. 2. Big Data Purpose
05:51
5. 3. Big Data Utilization
04:43
6. 4. Big Data Project
09:51
7. 5. Changes in Big Data Technology
05:13
8. 6. Big Data Implementation Technology
12:15
9. 8. R&R in Big Data
04:46
10. 7.Big Data Security
08:09

Section 3. Pilot Project Environment Setup

19 lectures ∙ (4hr 16min)

11. 0. Before you begin
02:38
12. 1. Understanding the Pilot Project Domain
12:43
13. 2. Understanding Pilot Architecture 1 - Software
07:16
14. 2. Understanding Pilot Architecture 2 - Hardware
06:33
15. 3. Pilot PC Environment Configuration - Development Environment
11:22
16. 4. VM Integrated Environment Configuration
15:12
17. [Note]_Pilot PC Environment Setup - Virtual Machine Environment Setup
17:37
18. [Reference]_Pilot Server Configuration 1 - CentOS Installation
14:02
19. [Reference]_Pilot Server Configuration 2 - CentOS Environment Setup
30:10
20. [Note] Pilot Server Configuration 3 - VM Cloning
19:03
21. [Note]_Big Data Cluster Configuration 1 - Cloudera Manager Installation
19:03
22. 5. Big Data Cluster Configuration 2 - Basic SW (Hadoop, ZooKeeper, etc.) Installation
18:59
23. 5. Big Data Cluster Configuration 3 - Adding DataNode and Environment Setup
17:24
24. 5. Big Data Cluster Configuration 4 - Connecting to Server Environment using Putty
02:13
25. 5. Big Data Cluster Configuration 5 - Trying out Hadoop and Zookeeper Commands
19:37
26. 6. Smart Car Log Simulator - Installation and Execution
16:19
27. 7. Pilot Environment Management - Start and End
10:41
28. 8. Understanding the Real-World Environment of Big Data
12:53
29. 9. Ending
03:02

Section 4. Big Data Collection

10 lectures ∙ (1hr 42min)

Section 5. Big Data Loading I - Large Files

8 lectures ∙ (1hr 11min)

Section 6. Big Data Loading II - Real-time Data

19 lectures ∙ (2hr 53min)

Section 7. Big Data Exploration

25 lectures ∙ (4hr 44min)

Section 8. Big Data Analysis I

22 lectures ∙ (4hr 43min)

Section 9. Big Data Analysis II

11 lectures ∙ (2hr 5min)

Section 10. Files

4 lectures

Published:

Last updated:

Reviews

All

121 reviews

4.8

121 reviews

ccw7704852
Reviews 12
∙
Average Rating 5.0
5
100% enrolled
It was one of the few lectures that allowed me to follow the big data practical project. It was very difficult to follow directly, but I received a lot of conceptual help. There is not much time left in the course, so I plan to review it again.
- 빅디
  Instructor
  Donggulnim! Thank you for your hard work on the pilot project! The lecture is a bit heavy because it covers a lot of big data. ^^;; Please review it again~! -BigD Dream
- seonggil
  Bigdi, I couldn't finish the course because I had to install Clouddera myself to configure the environment. Is it possible to extend the course period by one month? I'm sorry.
leehb2979
Reviews 1
∙
Average Rating 5.0
5
47% enrolled
The lecture was really good. It was very useful. I'm going to work in a related department again, so I want to study again, but the period has expired.ㅠㅠ Is there any discount for retaking the course? Thank you.
- 빅디
  Instructor
  leehb! Thank you for your evaluation of the good lecture! I extended the lecture period a little bit. I hope it will be of great help to your related work. - Big D Dream
namkey117399
Reviews 2
∙
Average Rating 5.0
5
98% enrolled
It's easy to understand how to configure and use the big data environment, and it's a great lecture that even those who don't go into big data should definitely listen to. Thank you!
- 빅디
  Instructor
  Hello! Nam Ki-beom! The key to the pilot project is to understand the overall flow.. Thank you for finishing it well. - Big D Dream
hyunjungio8388
Reviews 1
∙
Average Rating 5.0
5
9% enrolled
It's great to be able to follow the big data AI project. The lectures are easy to understand and I'll run through the project! I finished the pilot project~
- 빅디
  Instructor
  Hello! This is Big D! You have completed many difficult processes of the pilot project! Fighting until the end. - Big D Olim
seonggil
Reviews 1
∙
Average Rating 5.0
5
90% enrolled
Hello. This seems like a good lecture to learn the overall system.
- 빅디
  Instructor
  Hello! Seonggil! Thank you so much for the great lecture review. ^^* - Big D Dream

$102.30

Similar courses

Explore other courses in the same field!

Data Engineering Course (1): Installing Big Data Hadoop Directly

Billy Lee

Students who want to learn Hadoop and Big Data will celebrate the amazing advancements in experiencing the world of Big Data through this course!

초급

Big Data, Hadoop, Data Engineering

Data Engineering Course (1): Installing Big Data Hadoop Directly

Billy Lee

Big Data and Statistical Analysis Using R

kpcre

It covers basic data concepts, useful R functions and packages, and data analysis exercises, to allow anyone to perform big data analysis using R programming.

입문

R, Big Data

Big Data and Statistical Analysis Using R

kpcre

Big Data Processing (Spark) as Told by a Silicon Valley Leader

keeyonghan9539

How is processing big data different from processing data with Pandas? Let's learn about Spark, an essential framework for big data processing.

초급

Apache Spark, pyspark, Pandas

Big Data Processing (Spark) as Told by a Silicon Valley Leader

keeyonghan9539

The Fundamentals of Data Architecture You Must Know to Get Promoted

altoformula

Uncover true value in the age of data! 📊 Designing applications focused on data has now become essential. Develop the insight and skills your company wants with the latest trends and practical case studies. Start now with efficient data processing and design secrets! Your next step, leap into the data-driven world!

초급

Big Data, Architecture, Data Engineering

The Fundamentals of Data Architecture You Must Know to Get Promoted

altoformula

Big data analysis of technology trends using patent data

patspoon

We cover how to discover previously unknown signals of business and technological change through the collection, analysis, and visualization of patent big data!

입문

Big Data, Python, colab

Big data analysis of technology trends using patent data

patspoon

SQL Basics from a Silicon Valley Data Leader

keeyonghan9539

If you work with data, SQL is a fundamental skill you must know. In this course, we will learn SQL from a data analysis perspective, focusing on hands-on practice. The practice will be conducted in Google Colab using DuckDB.

초급

SQL, Data literacy, Data Engineering

SQL Basics from a Silicon Valley Data Leader

keeyonghan9539

Logpresso Enterprise - Dashboard

logpresso

This course covers how to use queries to build dashboards in Logpresso. We will discuss how to visualize real-time data, trigger alerts, and dynamically drill down and filter as needed.

초급

Big Data

Logpresso Enterprise - Dashboard

logpresso

Big Data Analysis Engineer Practical Exam Preparation (Using R)

companionclub

We will help those preparing for the Big Data Analysis Engineer Practical Exam with R to prepare for the exam. We will select and inform you of only the essential parts based on the questions that were on the Big Data Analysis Engineer Practical Exam. If you complete the course, you will be one step closer to passing the Big Data Analysis Engineer Practical Exam. We have reviewed the recent exam questions and uploaded related scripts and data. Also check out the latest exam information.

초급

Big Data, Engineer Big Data Analysis

Big Data Analysis Engineer Practical Exam Preparation (Using R)

companionclub

Complete Mastery of Azure Data Fundamentals for Data Beginners

daniellee

This is a special lecture that can lay the theoretical foundation to simultaneously prepare for the Microsoft AZ-900 certification, and as the latest content reflecting the scope of questions as of May 2025, by providing content related to core data concepts, Azure's relational data, Azure's non-relational data, and Azure's analytical workloads in a form combining theory and practice, it can be utilized as a meaningful educational opportunity to not only obtain the certification but also take the first step towards becoming a data professional.

입문

SQL, Big Data, Data Engineering

Complete Mastery of Azure Data Fundamentals for Data Beginners

daniellee

[2025] SQLD Problem Solutions - 176 Yellow Problems for Those Who Find SQLD Questions Difficult

datacodelab

SQLD Yellow Book 176 Problem Solving Lecture for You Who Studied but Cannot Solve Problems. After Completing the Course, You Will Become an Expert Beyond Passing. SQLD All-in-One Pass!

초급

SQL, SQLD, Big Data

[2025] SQLD Problem Solutions - 176 Yellow Problems for Those Who Find SQLD Questions Difficult

datacodelab

Probability and Statistics 101

루비네코딩

Finally, a probability and statistics course for everyone is here! Learn the principles of probability and statistics step by step through theory and coding practice.

초급

Probability and Statistics, Big Data, Python

Probability and Statistics 101

루비네코딩

Toss Senior Developer's Data Workflow Management-Based Large-Scale Data Processing Design Patterns [ By. Non-CS Major & Toss Developer ]

Hong

Learn the process of building data pipelines using Apache Airflow from basics to practical application. Understand Airflow's core concepts and architecture, and master advanced design patterns frequently used in practice such as dynamic DAGs, parallel processing, distributed processing, and Custom Operators through hands-on exercises. Set up a practice environment with Python and Docker, and develop practical skills to design and operate real workflows.

초급

Big Data, Docker, docker-compose

Toss Senior Developer's Data Workflow Management-Based Large-Scale Data Processing Design Patterns [ By. Non-CS Major & Toss Developer ]

Hong

[Management Course #3] DE, DBA (SSIS, SSAS, MachineLearning, BI, ETL)

vmproductor0202

SSIS, SSAS, MachineLearning, BI, ETL. You can learn important technologies that cannot be found in domestic books, YouTube, lectures, blogs, and academies. I also recommend it to those who are interested in employment at domestic large companies, American large companies, and American state funding agencies.

초급

Big Data, ssis, ssas

[Management Course #3] DE, DBA (SSIS, SSAS, MachineLearning, BI, ETL)

vmproductor0202

Building a stateful service for Daeyongrang Chat TPS

July

We will tell you everything about how to build a server and perform uninterrupted deployment for stateful services such as Chijijik and AfreecaTV.

초급

Go, Kafka, Node.js

Building a stateful service for Daeyongrang Chat TPS

July

Time Series Analysis and Forecasting

루비네코딩

Time Series: Become a Data Analysis Expert! Let's be analysts strong in theory & practice!

중급이상

Probability and Statistics, Python, Big Data

Time Series Analysis and Forecasting

루비네코딩

First time but like an expert with AI – I'm also a data analyst with just ChatGPT

Masocampus

It's now an era where data speaks, not intuition. Learn data analysis easily with ChatGPT!

초급

ChatGPT, Big Data, AI

First time but like an expert with AI – I'm also a data analyst with just ChatGPT

Masocampus

Certification and Practice! Business Information Visualization (Practical) Tableau All in One

onepm

This lecture aims to systematically learn the essential core concepts and functions absolutely necessary for the Business Information Visualization Practical Exam (Tableau), based on the exam guidelines of the organizing institution. It is structured around practical exercises so that you can freely use the functions frequently tested in the actual exam, and through solving mock exam problems of types A and B, you can improve your understanding of the exam types and your problem-solving skills together. Lecture plan and materials can be checked at https://github.com/hansikyung/Tableau_OneTime.

초급

Big Data, Tableau

Certification and Practice! Business Information Visualization (Practical) Tableau All in One

onepm

Pillow Investment Method: AI Stock Auto-Trading Machine That Makes Money While You Sleep

cheatkeylab

Revolutionize your stock investments with AI! In this lecture, you will directly build a real, working AI automated trading system targeting the top 25 NASDAQ stocks. We provide a special opportunity to gain experience and know-how through simulated investments with the 한국투자증권 API, and to perform AI stock automated trading with a real account. Even stock beginners will have no problem. We will easily explain basic stock concepts and why you should invest in US stocks, and provide all source code and remote support. From now on, investment is essential for the next 60 years of our lives. Create your own AI investment partner that will be with you!

입문

Python, Deep Learning(DL), Data Engineering

Pillow Investment Method: AI Stock Auto-Trading Machine That Makes Money While You Sleep

cheatkeylab

AI-Driven Practical Application Strategies in Manufacturing: Food and Pharmaceutical Industries

88888

This course covers how to leverage AI in the food and pharmaceutical manufacturing industry to enhance productivity and quality. Through real-world case studies, you'll learn how AI is applied in key stages such as raw material management, production processes, quality inspection, and regulatory compliance, while understanding defect rate reduction and efficient operational strategies. Through this course, learners will master ▲characteristics of the food and pharmaceutical industry and the necessity of AI adoption ▲data-driven quality management ▲predictive maintenance and equipment optimization ▲regulatory compliance monitoring and risk management ▲analysis of domestic and international implementation cases, gaining strategies and insights that can be immediately applied in the field.

입문

Machine Learning(ML), Deep Learning(DL), Big Data

AI-Driven Practical Application Strategies in Manufacturing: Food and Pharmaceutical Industries

88888

Mathematical Statistics Basics for Non-Majors (Practical)

SW School

This course is a course that practices the basics of machine learning mathematics and statistics using Python. Machine learning and deep learning require programming skills, but they also require a mathematical background to understand the principles. Through this course, you can gradually learn the basic mathematics required for artificial intelligence.

초급

Linear Algebra, Probability and Statistics, Python

Mathematical Statistics Basics for Non-Majors (Practical)

SW School

15-day big data pilot project

Reviews from Early Learners

What you will gain after the course

Core technologies of the 4th Industrial Revolution Understand both big data and AI!

Seeing the forest and the trees at the same time Everything about big data systems!

As a smart car pilot project Easy and fast practical learning.

As a 15-day pilot project Concepts and practice at the same time.

Who would benefit from learning this?

Complex big data + AI environment, Communication and collaboration skills are becoming increasingly important .

Essential learning environment.

The book of the knowledge sharer If you're curious?

Recommended for these people

HelloThis is .css-1q3zd4q{text-decoration-line:underline;text-underline-position:under;text-underline-offset:1px;}

Curriculum

Reviews

Similar courses

Core technologies of the 4th Industrial Revolution
Understand both big data and AI!

Seeing the forest and the trees at the same time
Everything about big data systems!

As a smart car pilot project
Easy and fast practical learning.

As a 15-day pilot project
Concepts and practice at the same time.

Complex big data + AI environment,
Communication and collaboration skills are becoming increasingly important .

The book of the knowledge sharer
If you're curious?

Recommended for
these people

Hello
This is