강의

멘토링

커뮤니티

BEST
Data Science

/

Data Engineering

Big Data Pipeline Master; Tools and Techniques for Success

You will learn about the four stages of big data processing [data collection ▶ data storage ▶ data analysis ▶ expression] in a more fun and systematic way through a code lab method consisting of 30% theory + 70% practice 🧑🏻‍🏫

(5.0) 21 reviews

346 learners

  • jphil
빅데이터
데이터처리
데이터분석
elk
elasticsearch
Big Data
Elasticsearch
Apache Spark
Kibana
Hadoop

Reviews from Early Learners

What you will gain after the course

  • Bigdata Processing Pipeline

  • Data Acquisition

  • Data Storage

  • Data Visualization

  • Data Analysis

  • Hadoop Distributed Filesystem

  • Spark Apache

  • ELK Stack (Elasticsearch)

Learn in a hands-on, hands-on manner
Master the Big Data Pipeline!

special thanks to my lovely students 👨🏻‍🎓 * appreciate it, believe you'll do well anywhere 👩🏻‍🎓



Data Processing Theory and Practice
The core of the big data pipeline !

Hello, this is J.PHIL 🙇🏻
Taking advantage of this great opportunity, Inflearn will be offering its first lecture , 'Data Processing Theory and Practice' , for beginners interested in building and analyzing big data systems.

Key words at a glance

Mastering Big Data Processing: Tools and Techniques for Success

Distributed System
Apache Spark
HDFS
Elasticsearch
Logstash
Kibana
Crawler
Scraping
Selenium
AWS S3
Node.js
Docker

Why are we taking this course ?
Should I listen? 📚

Due to the rapid technological advancements of the past 10 years or so, various platforms and services have been created, and various customers are living a high-quality life on them. In response, many companies are discovering and extracting valuable data from the data that is being generated in a hurry, and designing BM (Business Model) to provide us with a more valuable life.

In this environment, what and how should our engineers👷🏻 prepare if they “dare to predict and respond to the future”? They need to cultivate the ability to manage and handle data . Conversely, if you can handle data well and express it well, what can you contribute to the industry?

Data-driven decision-making

💡 Big data analytics enables organizations to make data-driven decisions, which in turn improves business outcomes.

Increased efficiency and productivity

💡 Big data analytics can help organizations streamline operations, reduce costs, and increase productivity.

Innovation

💡 Big data analytics can drive innovation by enabling companies to develop new products and services, improve existing products and services, and create new business models.


So how is this lecture?
Is it composed ? 📑

📝

Experience of writing a paper for a Data Top-Tier Conference

👨🏻‍💼

Valuable experience in building and analyzing big data systems gained in the field

🧑🏻‍🏫

Long experience in nurturing good students at university

Based on this valuable experience, I have structured the lecture into a broad yet informative course of 14 weeks or more on the four stages of the big data process to serve as a good starting point for “anyone interested in this field” 📚

You will learn about data collection ▶ data storage ▶ data analysis ▶ expression using the technologies introduced above in a code lab format of 30% theory and 70% practice . We have reflected and reflected on the valuable feedback from excellent students for about 6 years, and have organized the lectures with the easiest and highest quality content possible, so it will definitely be of great help to beginners.

Oh! For your reference, the lecture materials were written in English as much as possible so that you can find various references later or use this opportunity to help you in the research field or in a better company. 🧗🏻‍♀️


What do we learn? 🧑🏻‍🏫

Based on the Big Data Processing 4 Steps above, the curriculum is structured as follows. (Refer to the free video for Week 1)

Interested in big data pipelines?
Anyone can take the class 🧑🏻‍🎓

Anyone who knows Python, Linux commands, and basic knowledge of databases can take the course.

[Promotion] We support the cost of lectures for students and job seekers 💪

For students or job seekers without income We offer a discount of about 20% . Please apply through the link below and for smooth communication, please leave a log in the inquiry tab before taking the class , such as "${Self-introduction} student/job seeker [promotion] applied" :)

Application link / Pre-course inquiry

[Promotion] +200 students commemoration, extended promotion period💪

We are offering a 3-month free extension promotion for new students, excluding students who received the +100 person promotion. Please apply through the link below :)

Application Link

What is the practice environment like? 💻

If you prepare a stress-free environment as shown below, you will be able to follow the class.
(The actual cluster configuration will be covered in the [Beginner] theory lecture currently in production 🙏🏻)

  • OS: Ubuntu or Linux
  • Machine specifications
    • Aws t2.medium 2 Core 4GB // ec2 free.tier attendance is possible
    • You can attend with the above OS using Virtualbox

[Beginner DOCKER Course] Promotion Event 😄

For those who want to learn more about Docker, I highly recommend [Mastering Docker and Dockerizing for Beginners]. We will apply a promotion* to those who have taken [Mastering Big Data Pipelines].

[Big Data Cluster Construction Package] Launch Promotion Event 🎓

This is recommended for those who want to build a big data cluster with high availability using a solid code lab. Click on the lecture link on the side and leave a message in the [ Pre-course inquiry ] section saying "ID / Email / Promotion application."


Who created this course
Introducing J.PHIL ✒️

Recommended for
these people

Who is this course right for?

  • University students in their 3rd and 4th year who want to take a course on big data processing systems

  • Non-major developers interested in a career in data

  • Junior developer interested in data collection, storage, analysis, and visualization

  • Job seekers preparing for a big data job interview

Need to know before starting?

  • Python Basic Coding

  • Basic knowledge of Linux commands

  • Database Basics

Hello
This is

462

Learners

41

Reviews

50

Answers

4.9

Rating

2

Courses

안녕하세요 J.PHIL 입니다 🧑🏻‍🎓

첫번째 강의로 [ 빅데이터 시스템 구축 및 분석에 관심있는 입문자 ] 를 위해
"Mastering Big Data Processing: Tools and Techniques for Success" 강의를 오픈 하였습니다.

'수업 및 프로필' 자세한 사항들은 수업 상세 페이지에 잘 작성했으니 참고 부탁드립니다  🙏🏻

Curriculum

All

57 lectures ∙ (14hr 9min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

21 reviews

5.0

21 reviews

  • swmaclee8776님의 프로필 이미지
    swmaclee8776

    Reviews 2

    Average Rating 5.0

    5

    91% enrolled

    Hello teacher! I graduated from business administration and wanted to work on the field, so I have been studying development for over a year. I hear the words big data and big data processing a lot every day around me, so I want to know, but it is burdensome... Through this lecture, I covered each cycle in detail, so I think I learned a lot about data pipelines. First of all, since the time given was not much, I listened as much as I could, but I will review it during the remaining period and proceed with my own project based on it~~~!!! Please give me a lot of advice. Thank you~~!!

    • jphil
      Instructor

      Hello Mac, As a non-major developer, you must have had a hard time at first, but thank you for taking the class despite the hardships. Thanks to you, I will also be inspired and work even harder to create better content. I hope that Mac will become a better developer in the future and show even more value. Thank you.

  • outlier님의 프로필 이미지
    outlier

    Reviews 3

    Average Rating 5.0

    5

    100% enrolled

    Big data was something I had only vaguely felt, but after listening to the lecture, I began to understand the concept and imagine how to use it. The instructor has good diction and the lecture curriculum flows well in sequence. Thank you for the great lecture!

    • jphil
      Instructor

      Hello, Developer Dev, I am glad that you found it helpful as I have organized and lectured on the content that I have meaningfully experienced. Please listen comfortably when you review later and let me know if you have any questions.

  • snu님의 프로필 이미지
    snu

    Reviews 1

    Average Rating 5.0

    5

    28% enrolled

    I am currently running an interior startup! In the past, I didn't need to know about server operation and data analysis, but recently, I thought I needed to know about the perspective and direction of data operation, so I happened to listen to it on the recommendation of an acquaintance. It is very helpful because the lecturer considers the other person's perspective. HDFS may be a big hurdle for me, so I am taking other lectures first. I should recommend it to my acquaintances. I hope you continue to launch good lectures and your business goes well!!!!!

    • jphil
      Instructor

      Hello, Mr. Commania CEO, Thank you for coming all this way to listen to my lecture. I know that you must have a lot to worry about while running a company, but it is not easy to take an interest in designing pipelines and get into practice. I hope we can get through this difficult time together. If there is anything I can help you with, please feel free to contact me or post a question here. Fighting!

  • ntying7520님의 프로필 이미지
    ntying7520

    Reviews 1

    Average Rating 5.0

    5

    12% enrolled

    I took this course because I had a vague curiosity about big data while working as a developer. While taking the course, I was able to understand it more easily because it didn't just explain the theory, but also gave a general background lecture. It was also great because it led practical exercises in detail in between!! If you still don't know what big data is and are starting out with a vague curiosity as a developer, I think this course will be very helpful!

    • jphil
      Instructor

      Hello TY, Thank you for your valuable feedback. I hope you will take the remaining lectures diligently and gain a lot from them! I will come back with an even better image in the future.

  • jasonking님의 프로필 이미지
    jasonking

    Reviews 2

    Average Rating 5.0

    5

    65% enrolled

    Instructor. Thank you for the fun lecture. I haven't seen Inflearn lectures lately, but I'm watching the current lecture more interestingly than Mid. I think it's a lecture that condenses the know-how that was packed into a small amount of time as much as possible. If you make a more in-depth lecture next time (project-oriented, HDFS/Spark, AWS data analytics, etc.) it would be perfect. The current lecture was also very helpful. I thought it would be boring, but it's fun. I recommend this lecture to developers who want to know how to utilize the overall data platform. I don't usually write articles like this, but I'm writing this because it was helpful. Personally, one thing that's a bit disappointing is that the period is 4 months... I'm very disappointed that I can't watch it again when I want to. (I wonder if there's an extension event, Instructor Nam. -_-;;;) I watch it in detail once and watch it again a few months later. That way, it's imprinted in my head and I don't forget it.

    • jphil
      Instructor

      Hello jason.king, Thank you for your valuable and detailed course review. Since you said it was more fun than American dramas, I remember studying English on my own ten years ago by watching How I Met Your Mother. The reason why it was set to 4 months was because it was initially set to one semester at the time of production, so that students could focus and listen. We are running a partial extension promotion for those who are diligently taking the lecture, so please let us know when the deadline is approaching or has passed. Thank you for your feedback, I am glad that the lecture will be more widely known, and I hope you have a warm and enjoyable weekend.

Limited time deal ends in 8 days

$69,300.00

30%

$77.00

jphil's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!