inflearn logo
Challenge
Recruitment Closed

Building a Hadoop Ecosystem Using LLM

In this challenge, you will use AI Tutors and Vibe Coding to easily and quickly understand the complex Hadoop installation process and build core big data platforms such as Hadoop, HDFS, YARN, and Hive step-by-step. Rather than simply following commands, you will use generative AI to resolve installation errors, understand cluster configuration principles, and experience hands-on projects involving actual data storage and analysis. What you will learn: - How to build Hadoop using generative AI - Setting up a practice environment using VirtualBox and Linux (CentOS) - Building the Hadoop Ecosystem (HDFS, YARN, MapReduce, Hive) - Troubleshooting and resolving installation errors using AI - SQL-based big data analysis using Hive - Practical operations and management of big data platforms - Self-directed learning methods using AI Tutors - Hadoop operation experience through practical projects Challenge Features: ✔ Learning with an AI Tutor ✔ Vibe Coding-based practice ✔ Step-by-step construction practice ✔ Explanations that even beginners can follow ✔ Execution of practical, industry-focused projects ✔ Building a complete Hadoop Ecosystem

SQL
Hadoop
Linux
HeidiSQL
mapreduce

30개 수업 학습

라이브 1 회

무제한 복습, 내 것으로 만들어요.

지식공유자와 멘토링 혜택!

질문하고 즉시 답을 얻어요.

같은 기수와 교류하고 함께 성장해요.

ywjang23583님과 함께해요!

65

Learners

3

Reviews

4

Answers

4.3

Rating

10

Courses

I worked as a developer at LG Electronics, a telecommunications company, for about 27 years. Since retiring, I have been teaching introductory software coding courses at various universities, as well as lecturing at vocational schools and government offices. Currently, I am teaching an IoT course at a vocational training school.

I would like to record and share lectures on the following topics.

1. R Statistics Basic/Advanced Course

2. Arduino for the sensor data collection part of IoT technology techniques

3. Raspberry Pi Technology

4. Basic/Advanced Course for AI Utilization (Understanding Basic Algorithms and Tool Usage)

5.Systematic platform implementation techniques for smart farm configuration

6. Tableau and PowerBI visualization techniques

7. Six Sigma technical techniques in the field

8. Building a Big Data Analysis Hadoop Ecosystem

More

Learning by Doing: Building a Hadoop & Hive Big Data Platform

Challenge Introduction

This is a practice-oriented challenge where you will directly build and operate Hadoop and Hive, the core technologies of the big data era.

This is not a lecture where you only learn theory.

In this challenge, you will build an actual big data platform through step-by-step hands-on exercises, ranging from setting up a virtual environment to installing Hadoop, operating HDFS, understanding MapReduce, and building a Hive data warehouse for data analysis.

We provide a step-by-step practical guide so that even beginners can follow along, allowing you to directly experience the core concepts of the Hadoop Ecosystem used in the industry.


Recommended for the following people

  • Beginners who are new to big data platforms

  • Those who want to learn Hadoop and Hive through hands-on practice

  • Job seekers preparing to become data engineers

  • Those who want to learn how to build a data analysis environment

  • Developers and engineers who want to expand their practical IT skills

  • Those who want to learn big data-based technologies for AI and data analysis


What you will learn in this challenge

Week 1: Building the Hadoop Platform

  • Overview of Hadoop and Understanding Big Data Architecture

  • VirtualBox environment configuration

  • Building a Linux server

  • Hadoop Installation and Configuration

  • Understanding HDFS Structure

  • Configuring NameNode and DataNode

  • HDFS File Storage and Management Practice

  • Fundamentals of Hadoop Cluster Operation

Week 2: Building a Hive Data Analysis Environment

  • Understanding Hive Overview and Architecture

  • Hive Installation and Configuration

  • Basic HiveQL Syntax

  • Data Loading and Management

  • Utilizing external and internal tables

  • Writing aggregation and analysis queries

  • Log Data Analysis Practice

  • Hadoop Ecosystem Integration and Utilization


Live Session Operation

During the challenge period, we will cover the following topics together through live sessions.

  • Support for setting up the practice environment

  • Troubleshooting installation errors

  • Sharing Hadoop operational know-how

  • HiveQL Practice Coaching

  • Real-time Q&A

  • Feedback on student practice results

We will demonstrate the actual setup process through screen sharing and check the progress of your hands-on practice together.


Outcomes you will achieve after participating

  • Ability to build a Hadoop single-node cluster

  • HDFS operation and management skills

  • Hive-based data analysis skills

  • Experience in building a Linux-based Big Data environment

  • Securing foundational practical skills for data engineers

  • Understanding and ability to utilize the Hadoop Ecosystem


Requirements

  • Windows 10/11 PC

  • 8GB RAM or more recommended (16GB or more recommended)

  • Environment where VirtualBox can be installed

  • Passion for learning


Instructor Introduction

Instructor Young-wan Jang has conducted numerous lectures and practical training sessions in the fields of Big Data, Databases, and AI applications.

In this challenge, we guide you to learn Hadoop and Hive through hands-on practice based on real-world implementation experience, rather than just simple theoretical explanations.

"Learning by building it yourself is the fastest way to learn."

Take the first step in building a big data platform through this challenge.

강사 프로필
LIVE

함께 소통할 수 있는 라이브가 예정되어 있어요!

07.20.월

오전 10:00

하둡에코시스템을 응용하여 봅시다.

7월

19일

챌린지 시작일

2026년 7월 19일 오후 03:00

챌린지 종료일

2026년 7월 31일 오후 02:30

챌린지 커리큘럼

All

31 lectures ∙ (8hr 50min)

Course Materials:

Lecture resources
챌린지 전용 수업
Live

챌린지에서 배워요

  • Installing a Hadoop cluster and building an HDFS-based distributed storage environment

  • Building a Hive Data Warehouse and Data Analysis Based on HiveQL

  • Practical skills in big data platform operation and management

Recommended for
these people

Who is this course right for?

  • Data engineers or developers preparing to build big data platforms

  • Data analysts who want to apply the Hadoop ecosystem to practical work

  • IT professionals who want to gain experience in building big data infrastructure

Need to know before starting?

  • Experience using basic Linux commands

  • Understanding Basic SQL Syntax

  • Basic concepts of databases or data processing

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

이 강의의 지난 수강평

FAQs

취소 및 환불 규정
챌린지는 지식공유자가 설정한 수업 최소 정원이 충족되지 않을 경우, 폐강 안내가 고지되며 결제 내역이 자동취소됩니다.

ywjang23583's other courses

Check out other courses by the instructor!

Access is restricted to non-public courses.