For those who want to learn data science, big data, and crawling - We've designed it so that you can quickly learn the latest and best crawling technologies with various examples.
I am listening to all of Mr. Janjaemi's lectures.
I am not a major, but I really want to crawl, so I have been listening to them consistently since last year.
The advantage of Mr. Janjaemi's lectures is that he explains them step by step in an easy-to-understand way. For example, he breaks down the entire code from start to finish and explains it. As a non-major, this style of teaching really resonated with me. Also, the fact that he gives me encouragement here and there is really helpful.
The teacher told me to use Google and Stack Overflow to improve my coding skills, so I spend 3 or 4 hours Googling and solving errors. Thanks to him, I feel like I have grown a lot when I compare myself from last month to now. It's all thanks to him.
Thank you so much for always uploading quality lectures. ^^
5.0
Jay
100% enrolled
Thank you to Mr. Dave Lee, who creates a virtuous cycle with good lectures!
This lecture is full of consideration and sincerity for the students.
I highly recommend it to those who want to learn how to catch fish rather than those who want to be given fish!
I will continue to cheer you on with great lectures in the future~!!
5.0
Samuel Jeon
100% enrolled
Teacher! Wow~ I finally finished the second crawling lecture. After finishing the first lecture, I gained momentum and finished the second lecture quickly. It's really fun to see all kinds of knowledge coming into my head and merging them. Actually, I'm a graduate student studying machine learning and deep learning, but I feel like I lack basic knowledge to be a data analyst, so I'm taking the lectures according to the roadmap. Now, I need to quickly listen to and internalize mySQL and NoSQL, and then move on to Pandas. Thank you for the great lecture!
What you will gain after the course
Intermediate Python Crawling Techniques
Scrapy Crawling Framework Technology
Dynamic web page crawling technology
Selenium, Headless Chrome Crawling Technology
The official lecture chosen by Nekarakubae as an in-house lecture! For data science/analytics careers Learn the latestPython crawlingcollection techniques Highly complete lectures
This course builds on the Python Introduction and Crawling Basics bootcampcourses, systematically mastering intermediate crawling and Python data collection techniques. Designed to be used alongside professional work, this course is designed with the student's perspective in mind, unlike typical IT lectures. In addition to the lectures,you'll learn each function one by one, allowing you to quickly master the material and further develop your data processing capabilities.
This course is designed for those who have completed the Python Introduction and Crawling Basics bootcamp courses. It focuses on intermediate data collection techniques. It's designed for those considering careers in data science/analysis or full-stack development.
How do I build the foundation for a data analytics/science career?
You should learn Python and go through the entire data analysis process.
You can learn data collection, data storage, data analysis, and data prediction in order, step by step. Since the entire process is done in Python in the workplace, you can learn the entire process using Python.
This course is designed to teach you intermediate data collection techniques. It utilizes the crawling and basic Python skills learned in the Python Introduction and Crawling Basics bootcamps, and further teaches you the latest data collection technologies, Selenium and the Scrapy framework.
You need to cover the entire data science process! You can learn the basics of handling data.
However, these days, webpage creation technologies are diverse. Broadly speaking, they can be divided into static and dynamic webpages. Data collection from dynamic webpages is difficult using basic crawling techniques.
Selenium is a technology that can collect data from dynamic web pages. It can also automatically collect data from web pages that require specific actions, such as logging in, or from pages that require data to be retrieved after performing a specific action.
Additionally, the Scrapy framework is a technology used for professionally collecting large amounts of data. It offers a variety of features and, most importantly, boasts fast crawling speeds.
In this lecture, in addition to Selenium and Scrapy, We also cover other crawling techniques, Headless Chrome and XPATH! This course will help you master the basics of crawling, along with an introduction to Python and a crawling bootcamp.
* This course leverages the Python programming, IT fundamentals, and crawling skills learned in the Python Introduction and Crawling Basics bootcamps. By further exploring the Selenium and Scrapy frameworks, you'll not only solidify your existing skills through repetition, but also approach them from different angles, mastering all existing data collection techniques and solidifying your foundation in Python and data science data collection.
To help you become familiar with relevant application techniques in a short period of time We provide lectures based on various codes and materials, step-by-step and technology-specific.
Don't waste your time! It's not that we can't do something because we don't have the information! Learn with proven courses!
Have you ever paid millions of won for a course that only taught grammar? We've designed the course to naturally build a solid foundation by providing practice problems and code patterns to help you become familiar with the concepts, ensuring they become ingrained in your brain and readily applicable to real-world applications.
This lecture is an improved version of the previous lecture.
We've designed this course to complement the shortcomings of existing lectures and provide more practice. For this course, we've created a test site specifically for you to use and test various intermediate crawling techniques.
<center><div style="width:80%;padding:0.5rem;text-align:center"><p style="color:#2186c4;font-weight:bold;font-size:1.2rem;text-align:center;margin:0px;line-height:158%"> <span style="color:#ba372a">So that you can feel, 'Ah! It's really different!'<br /> This is a lecture that is created through constant thought and improvement.</span><br /> Be reasonable and considerate of each other<br /> Only those who can form good relationships<br /> Please take the class! </p></div></center>
We're creating a roadmap to help you build the fundamentals step by step to prepare for a data and full-stack career.
Data Analytics/Science Course: Building a Solid Foundation for Data Analysts and Scientists
They are numbered according to the order in which they are learned.
Key Experience: Coupang Senior Development Manager/Principal Product Manager, Samsung Electronics Development Manager (Approx. 15 years of experience)
Education: BA in Japanese Language and Literature, Korea University / MS in Computer Science, Yonsei University (A complete mix)
Key Development Experience: Samsung Pay, E-commerce Search Service, RTOS Compiler, Linux Kernel Patch for NAS
Books: Linux Kernel Programming, Understanding and Developing the Linux Operating System, IT Core Technologies That Anyone Can Easily Read and Understand, Python Programming Primer for Absolute Beginners
Thank you to Mr. Dave Lee, who creates a virtuous cycle with good lectures!
This lecture is full of consideration and sincerity for the students.
I highly recommend it to those who want to learn how to catch fish rather than those who want to be given fish!
I will continue to cheer you on with great lectures in the future~!!
I've been trying out various things because I'm having fun with scraping lately, and I took the Scrapy lecture.
As I listened to the lecturer's explanation, I became a little interested in data analysis/science. I don't plan on becoming a data scientist yet, but I plan on taking the lecturer's next lecture.
I enjoyed following along because he explained the big picture well and even told me where I could make mistakes.
Thank you^^
Studying with interest is bound to yield results, and in the process, you will develop and your goals will change~Let's have fun together in the next lecture!! Fighting!!
This curriculum was also very informative.
It was good to be able to study and apply Python libraries and representative frameworks together :)
However, time to review and internalize on your own is essential. After class, I always create problems to apply on my own and study, and my understanding seems to increase significantly.
There was a time when I couldn't solve a problem I tried to solve on my own and couldn't make progress for 2 days. At the time, I was worried that my speed would slow down, but as time passed, these days actually helped me more.
Dave, thank you for your great lectures!!
Oh, that's right. I know Heokuk's ID. The time you spent thinking about it for a long time was not a waste of time, but a necessary time. I believe that by searching for a lot of information, and by reading other articles, you will become familiar with this process and it will become your bones and flesh. It's good to see you working hard.
Overall review of the lecture up to the latter half of the lecture
Advantages
- As a working developer, he explains various techniques used in the field in a way that is friendly to the students.
- There is a unique lecture system, and the lectures are opened in order on Inflearn, so it is convenient for the students to follow them in order.
- When asking questions about the lecture content, it seems that the answers are given within 3 days, and he shows his sincerity.
Disadvantages
- When the students ask questions, he answers in a strangely sarcastic tone. The students, who paid for the lecture, asked because they did not understand the lecture content, but he answered in a tone that asked why they were asking obvious questions.
- There are parts of the lecture that are missing. Since the students pay for the lecture assuming a perfect lecture, this is clearly the instructor's fault. When I asked about this, he replied that he was not at fault and that he did not care about others, but only about him. After looking into it, it turned out that he had missed the lecture, and I did not hear an apology for this.
- He repeatedly asked for a high rating for his lecture in the video. Aside from the quality of the lectures, it doesn't look that good.
When you point out a lecture, is it because the student is upset, not because of the instructor's fault? You're taking the subject very strangely. I didn't give the feedback above because I was upset.
When I asked about the image crawling, not just the tag part, you said something like, "No one else said anything, but you're the only one saying that part is missing. Didn't you miss it?" And when another person replied to the same issue, you only admitted that there was an omission, and you didn't apologize for your mistake at all. You only brought up the records that make it seem like you didn't do anything wrong, even though there are all the records left?
And I don't understand it well, but are you the type of person who only understands the parts that you want to understand? As someone who paid for the lecture, I exercised my right to evaluate. This isn't feedback to hear excuses or an apology from the instructor. And after that, whether or not I take Mr. Janjaemi Coding's lecture is my freedom, but what kind of etiquette is it to say, "You won't take my lectures after that"? Are you saying that I gave you a low score, so don't take my lectures? There were some good parts, but there were definitely some shortcomings, and I pointed out the rude parts in communication as a student who paid for the lecture. And other people who are planning to take this lecture have the right to know about these parts.
The following is a part of the questions I asked. It's hard to find a polite answer or a sincere apology here.
==================================
Question: Is there no content about image crawling in this lecture? It's included in the lecture materials, but this lecture doesn't have any content about image crawling, so I'm asking.
Answer: The following lecture is currently linked as a related lecture. This lecture is about crawling images and downloading the crawled images to your PC??? Other people are listening well, so I don't understand something??? I wonder if you are thinking of another function for image crawling other than the lecture I mentioned, or if the lecture is not visible. There is an explicit lecture.
Question: Yes. I am listening well from Python Basics. The lecture structure is solid, and I would like to first say thank you for uploading various materials. If you listen to the lecture again, you will know well, but this lecture is about crawling by going to the blog and turning the pages. If you look at the lecture material (crawling_advanced_practice.ipynb) of the lecture, there is a content about '2. Downloading images with Selenium'. However, the lecture does not cover this, so I am asking.
Please let me know if there is anything I missed.
Answer: I was mistaken. One lecture was missing. I have uploaded it again. If you look at the multi-page, you will be able to continue.