Big Data Pipeline Master; Tools and Techniques for Success
You will learn about the four stages of big data processing [data collection ▶ data storage ▶ data analysis ▶ expression] in a more fun and systematic way through a code lab method consisting of 30% theory + 70% practice 🧑🏻🏫
Learn in a hands-on, hands-on manner Master the Big Data Pipeline!
special thanks to my lovely students 👨🏻🎓* appreciate it, believe you'll do well anywhere👩🏻🎓
Data Processing Theory and Practice The core of the big data pipeline !
Hello, this is J.PHIL 🙇🏻 Taking advantage of this great opportunity, Inflearn will be offering its first lecture , 'Data Processing Theory and Practice' , for beginners interested in building and analyzing big data systems.
Key words at a glance
Mastering Big Data Processing: Tools and Techniques for Success
Distributed System
Apache Spark
HDFS
Elasticsearch
Logstash
Kibana
Crawler
Scraping
Selenium
AWS S3
Node.js
Docker
Why are we taking this course ? Should I listen? 📚
Due to the rapid technological advancements of the past 10 years or so, various platforms and services have been created, and various customers are living a high-quality life on them. In response, many companies are discovering and extracting valuable data from the data that is being generated in a hurry, and designing BM (Business Model) to provide us with a more valuable life.
In this environment, what and how should our engineers👷🏻 prepare if they “dare to predict and respond to the future”? They need to cultivate the ability to manage and handle data . Conversely, if you can handle data well and express it well, what can you contribute to the industry?
Data-driven decision-making
💡 Big data analytics enables organizations to make data-driven decisions, which in turn improves business outcomes.
Increased efficiency and productivity
💡 Big data analytics can help organizations streamline operations, reduce costs, and increase productivity.
Innovation
💡 Big data analytics can drive innovation by enabling companies to develop new products and services, improve existing products and services, and create new business models.
So how is this lecture? Is it composed ? 📑
📝
Experience of writing a paper for a Data Top-Tier Conference
👨🏻💼
Valuable experience in building and analyzing big data systems gained in the field
🧑🏻🏫
Long experience in nurturing good students at university
Based on this valuable experience, I have structured the lecture into a broad yet informative course of 14 weeks or more on the four stages of the big data process to serve as a good starting point for “anyone interested in this field” 📚
You will learn about data collection ▶ data storage ▶ data analysis ▶ expression using the technologies introduced above in a code lab format of 30% theory and 70% practice . We have reflected and reflected on the valuable feedback from excellent students for about 6 years, and have organized the lectures with the easiest and highest quality content possible, so it will definitely be of great help to beginners.
Oh! For your reference, the lecture materials were written in English as much as possible so that you can find various references later or use this opportunity to help you in the research field or in a better company. 🧗🏻♀️
What do we learn? 🧑🏻🏫
Based on the Big Data Processing 4 Steps above, the curriculum is structured as follows. (Refer to the free video for Week 1)
Interested in big data pipelines? Anyone can take the class 🧑🏻🎓
Anyone who knows Python, Linux commands, and basic knowledge of databases can take the course.
[Promotion] We support the cost of lectures for students and job seekers 💪
For students or job seekers without incomeWe offer a discount of about 20% . Please apply through the link below and for smooth communication, please leave a log in the inquiry tab before taking the class , such as "${Self-introduction} student/job seeker [promotion] applied" :)
[Promotion] +200 students commemoration, extended promotion period💪
We are offering a 3-month free extension promotion for new students, excluding students who received the +100 person promotion. Please apply through the link below :)
If you prepare a stress-free environment as shown below, you will be able to follow the class. (The actual cluster configuration will be covered in the [Beginner] theory lecture currently in production 🙏🏻)
OS: Ubuntu or Linux
Machine specifications
Aws t2.medium 2 Core 4GB // ec2 free.tier attendance is possible
You can attend with the above OS using Virtualbox
[Beginner DOCKER Course] Promotion Event 😄
For those who want to learn more about Docker, I highly recommend [Mastering Docker and Dockerizing for Beginners]. We will apply a promotion* to those who have taken [Mastering Big Data Pipelines].
[Big Data Cluster Construction Package] Launch Promotion Event 🎓
This is recommended for those who want to build a big data cluster with high availability using a solid code lab. Click on the lecture link on the side and leave a message in the [ Pre-course inquiry ] section saying "ID / Email / Promotion application."
Who created this course Introducing J.PHIL ✒️
Recommended for these people
Who is this course right for?
University students in their 3rd and 4th year who want to take a course on big data processing systems
Non-major developers interested in a career in data
Junior developer interested in data collection, storage, analysis, and visualization
Job seekers preparing for a big data job interview
Need to know before starting?
Python Basic Coding
Basic knowledge of Linux commands
Database Basics
Hello This is
462
Learners
41
Reviews
50
Answers
4.9
Rating
2
Courses
안녕하세요 J.PHIL 입니다 🧑🏻🎓
첫번째 강의로 [ 빅데이터 시스템 구축 및 분석에 관심있는 입문자 ] 를 위해 "Mastering Big Data Processing: Tools and Techniques for Success" 강의를 오픈 하였습니다.
'수업 및 프로필' 자세한 사항들은 수업 상세 페이지에 잘 작성했으니 참고 부탁드립니다 🙏🏻
Hello teacher!
I graduated from business administration and wanted to work on the field, so I have been studying development for over a year. I hear the words big data and big data processing a lot every day around me, so I want to know, but it is burdensome... Through this lecture, I covered each cycle in detail, so I think I learned a lot about data pipelines.
First of all, since the time given was not much, I listened as much as I could, but I will review it during the remaining period and proceed with my own project based on it~~~!!! Please give me a lot of advice. Thank you~~!!
Hello Mac,
As a non-major developer, you must have had a hard time at first, but thank you for taking the class despite the hardships. Thanks to you, I will also be inspired and work even harder to create better content. I hope that Mac will become a better developer in the future and show even more value.
Thank you.
Big data was something I had only vaguely felt, but after listening to the lecture, I began to understand the concept and imagine how to use it.
The instructor has good diction and the lecture curriculum flows well in sequence.
Thank you for the great lecture!
Hello, Developer Dev,
I am glad that you found it helpful as I have organized and lectured on the content that I have meaningfully experienced.
Please listen comfortably when you review later and let me know if you have any questions.
I am currently running an interior startup! In the past, I didn't need to know about server operation and data analysis, but recently, I thought I needed to know about the perspective and direction of data operation, so I happened to listen to it on the recommendation of an acquaintance. It is very helpful because the lecturer considers the other person's perspective. HDFS may be a big hurdle for me, so I am taking other lectures first. I should recommend it to my acquaintances. I hope you continue to launch good lectures and your business goes well!!!!!
Hello, Mr. Commania CEO,
Thank you for coming all this way to listen to my lecture. I know that you must have a lot to worry about while running a company, but it is not easy to take an interest in designing pipelines and get into practice. I hope we can get through this difficult time together. If there is anything I can help you with, please feel free to contact me or post a question here. Fighting!
I took this course because I had a vague curiosity about big data while working as a developer.
While taking the course, I was able to understand it more easily because it didn't just explain the theory, but also gave a general background lecture. It was also great because it led practical exercises in detail in between!!
If you still don't know what big data is and are starting out with a vague curiosity as a developer, I think this course will be very helpful!
Hello TY,
Thank you for your valuable feedback. I hope you will take the remaining lectures diligently and gain a lot from them! I will come back with an even better image in the future.
Instructor. Thank you for the fun lecture.
I haven't seen Inflearn lectures lately, but I'm watching the current lecture more interestingly than Mid.
I think it's a lecture that condenses the know-how that was packed into a small amount of time as much as possible.
If you make a more in-depth lecture next time (project-oriented, HDFS/Spark, AWS data analytics, etc.) it would be perfect.
The current lecture was also very helpful. I thought it would be boring, but it's fun.
I recommend this lecture to developers who want to know how to utilize the overall data platform.
I don't usually write articles like this, but I'm writing this because it was helpful.
Personally, one thing that's a bit disappointing is that the period is 4 months... I'm very disappointed that I can't watch it again when I want to. (I wonder if there's an extension event, Instructor Nam. -_-;;;)
I watch it in detail once and watch it again a few months later.
That way, it's imprinted in my head and I don't forget it.
Hello jason.king,
Thank you for your valuable and detailed course review. Since you said it was more fun than American dramas, I remember studying English on my own ten years ago by watching How I Met Your Mother.
The reason why it was set to 4 months was because it was initially set to one semester at the time of production, so that students could focus and listen. We are running a partial extension promotion for those who are diligently taking the lecture, so please let us know when the deadline is approaching or has passed.
Thank you for your feedback, I am glad that the lecture will be more widely known, and I hope you have a warm and enjoyable weekend.