Master crawling by following along with Data Workshop
Python Crawling Master. This one is all you need for everything from installation to application.
I've packed in only the essential content for real use.
Only the essential Python grammar, easier than anyone else
The Essence of Crawling! Key Tips
This is not a lecture that you just watch, but one that you input and execute yourself.
Manipulating browser using selenium
Finding what you want in HTML (feat.BeautifulSoup)
Save crawling results as an Excel file
Comparing the pros and cons of crawling methods
We will teach you crawling know-how to comfortably catch fish and swim in the sea of information.
📑 Check if any of the items on the list below apply to you!
✅ I personally edit and check each repetitive task every day.
✅ I don't have time to do repetitive tasks, so I can't even think about doing important analysis work.
✅ I want to efficiently create simple graphs, simple PPTs, and reports.
✅ I feel guiltyabout the work of endlessly repeating Ctrl + C and Ctrl + V.
✅ I want to let the computer do the work and invest my time, energy, and effort in what really matters.
👉 If one or more of these apply to you, you should take this course.
Crawling tips for catching fish and splashing in the ocean of information 📑
Is there any data that isn't available on the internet these days? There isn't. It would be nice to save and use all the data you find, but how easy is that? Making the difficult possible— collecting information from web pages— is called crawling . Learning crawling would be a great way to improve work efficiency, wouldn't it? However, there are numerous Python crawling methods. Learning them all would be tedious and time-consuming. And not many people even know them all.
This course is a compilation of my work, which I've spent all night researching, testing, and implementing. I've removed unnecessary and redundant information, selecting only the essential commands and techniques that remain. I'll teach you the essentials, without any details.
"Data Workshop" that you can trust and watch 💪
More than a thousand people still visit my blog every day to read articles like the crawling basics I wrote three years ago.
Since writing this article three years ago, I've been working on many projects, reviewing Q&As, and testing new ones. So far, I've never had a problem with the techniques I've compiled. While numerous libraries and various methods are emerging, if you master the most fundamental ones, you can apply them to anything . I'm not offering short-term solutions, but rather methods that can be used in various ways, and can be used for years to come .
Don't get lost in all the various commands and lectures. Join "Data Workshop." I'll introduce the core concepts I've confidently compiled through countless trials and errors. If you skip to another lecture now, you'll come back and say, "Ah... I should've listened to that right then..." Knowing it is a skill, not a skill! Learning this skill will make your life truly comfortable!
What kind of lecture is this? 🧐
This is not a lecture where you just read the code, run it, and move on.
We type each one out ourselves, explain, interpret, and think about it together .
In other words, it is not an easy lecture.
This is not a lecture where you can just sit back and do the exercises or just listen.
This is an uncomfortable lecture that requires you to keep typing and following along .
What you will learn in this course ✏️
From Python installation to Python usage essential for crawling
Web page information visible to my eyes
Crawling technology that eliminates the need for Ctrl + C and Ctrl + V
No unnecessary words or words that seem to be there or content that is not useful!
Exactly! Only the essentials that can be utilized 200%!
Tools covered here 🧰
A computer for practice is required during the lecture.
Installing Python 3.x
Installing Jupyter Notebook
Install Chrome browser
Your computer specs should be fine as long as it doesn't take more than 20 minutes to boot.
We recommend using Anaconda to install Python. Please refer to the installation guide at https://m.blog.naver.com/kiddwannabe/221154599192
Expected Questions Q&A 🙋🏻♂️
Q. Can non-majors take the course? I'm new to coding... A. This course is for non-majors. We'll walk you through the process step-by-step, starting with program installation. I'll be constantly sharing my tips and tricks. I recommend watching all the lecture videos without missing a single one.
※ If you are familiar with programming, we recommend listening to it at a faster pace or taking other lectures.
Q. Who would benefit from listening to this? A. Anyone curious about what they can do with Python! Are you scared because it's your first time programming? Anyone who wants to leave work to the computer!
Q. What is the difference from other lectures? A. This is not a lecture where you just look at the PPT! This is not a lecture that just reads the code you've already entered! This is a practical lecture where you input and execute each command, check for errors, and examine the results.
Q. Are there any practice files and organized materials? A. We will proceed by typing each part in an empty Jupyter notebook to suit the live coding environment as much as possible, and we will proceed with the lecture using PPT diagrams for parts that absolutely require explanation with images.
You finished the lecture in one day!
I'm glad it was helpful. ^^ Thank you for leaving a comment.
I'm preparing other lectures, so please look forward to them ^^