강의

멘토링

커뮤니티

BEST
Data Science

/

Data Engineering

Easy Python Advanced Crawling [Scrapy, Selenium, Headless Chrome]

For those who want to learn data science, big data, and crawling - We've designed it so that you can quickly learn the latest and best crawling technologies with various examples.

(4.7) 45 reviews

866 learners

  • funcoding
"쉽지만 가볍지 않습니다"
Web Crawling
Scrapy
Selenium
Big Data

Reviews from Early Learners

What you will gain after the course

  • Intermediate Python Crawling Techniques

  • Scrapy Crawling Framework Technology

  • Dynamic web page crawling technology

  • Selenium, Headless Chrome Crawling Technology

The official lecture chosen by Nekarakubae as an in-house lecture! 
For data science/analytics careers
Learn the latest Python crawling collection techniques
Highly complete lectures

This course builds on the Python Introduction and Crawling Basics bootcamp courses, systematically mastering intermediate crawling and Python data collection techniques. Designed to be used alongside professional work, this course is designed with the student's perspective in mind, unlike typical IT lectures . In addition to the lectures, you'll learn each function one by one, allowing you to quickly master the material and further develop your data processing capabilities .

This course is designed for those who have completed the Python Introduction and Crawling Basics bootcamp courses. It focuses on intermediate data collection techniques. It's designed for those considering careers in data science/analysis or full-stack development.

How do I build the foundation for a data analytics/science career?
  • You should learn Python and go through the entire data analysis process.
  • You can learn data collection, data storage, data analysis, and data prediction in order, step by step. Since the entire process is done in Python in the workplace, you can learn the entire process using Python.
  • This course is designed to teach you intermediate data collection techniques. It utilizes the crawling and basic Python skills learned in the Python Introduction and Crawling Basics bootcamps, and further teaches you the latest data collection technologies, Selenium and the Scrapy framework.

You need to cover the entire data science process!
You can learn the basics of handling data.

What are the Selenium and Scrapy frameworks?
  • In the Python Introduction and Crawling Basics Bootcamp , I learned basic Python programming syntax and crawling techniques to automatically collect various data from web pages based on the bs4 library.
  • However, these days, webpage creation technologies are diverse. Broadly speaking, they can be divided into static and dynamic webpages. Data collection from dynamic webpages is difficult using basic crawling techniques.
  • Selenium is a technology that can collect data from dynamic web pages. It can also automatically collect data from web pages that require specific actions, such as logging in, or from pages that require data to be retrieved after performing a specific action.
  • Additionally, the Scrapy framework is a technology used for professionally collecting large amounts of data. It offers a variety of features and, most importantly, boasts fast crawling speeds.

In this lecture, in addition to Selenium and Scrapy,
We also cover other crawling techniques, Headless Chrome and XPATH!
This course will help you master the basics of crawling, along with an introduction to Python and a crawling bootcamp.

* This course leverages the Python programming, IT fundamentals, and crawling skills learned in the Python Introduction and Crawling Basics bootcamps. By further exploring the Selenium and Scrapy frameworks, you'll not only solidify your existing skills through repetition, but also approach them from different angles, mastering all existing data collection techniques and solidifying your foundation in Python and data science data collection.


To help you become familiar with relevant application techniques in a short period of time
We provide lectures based on various codes and materials, step-by-step and technology-specific.

Don't waste your time!
It's not that we can't do something because we don't have the information!
Learn with proven courses!

Have you ever paid millions of won for a course that only taught grammar? We've designed the course to naturally build a solid foundation by providing practice problems and code patterns to help you become familiar with the concepts, ensuring they become ingrained in your brain and readily applicable to real-world applications.

This lecture is an improved version of the previous lecture.

We've designed this course to complement the shortcomings of existing lectures and provide more practice.
For this course, we've created a test site specifically for you to use and test various intermediate crawling techniques.

So that you can feel, 'Ah! It's really different!'
This is a lecture that is created through constant thought and improvement.

Be reasonable and considerate of each other
Only those who can form good relationships
Please take the class!

We're creating a roadmap to help you build the fundamentals step by step to prepare for a data and full-stack career.

Data Analytics/Science Course: Building a Solid Foundation for Data Analysts and Scientists

They are numbered according to the order in which they are learned.

  1. Introduction to Python and Data Collection (Crawling) Basics (Python, the Web, and Data Understanding Basics)
  2. Easy, Advanced Python Crawling for Beginners (Professional Crawling Techniques, Not Included in Data Roadmap)
  3. SQL and Data Storage/Analysis Basics (Learn SQL and store/analyze data)
  4. NoSQL (MongoDB) Big Data Basics (Learn NoSQL and Store/Analyze Big Data)
  5. Beginner Python Data Analysis (Data Preprocessing, Pandas, and Modern Visualization) [Data Science Part 1]
  6. Beginner Python Machine Learning Bootcamp (Easy! Learn concepts and applications through real-world problems) [Data Science Part 2]
  7. Deep Learning and PyTorch Bootcamp for Beginners [Data Science Part 3]

* We are also offering our current data science course packages at a discounted price (the discount will be reduced soon)
[Introductory to Beginner] Easily and Thoroughly Master the Basics of Data Science for Employment (Shortcut)

Full Stack Course: A Tech Tree to Create the Latest Web/App Services from A to Z on Your Own

They are numbered according to the order in which they are learned.

1. Python and Data Collection (Crawling) Basics (Python and the Web, Data Understanding Basics)
2. MySQL and Data Storage/Analysis Basics (Learn SQL and store/analyze data)
3. NoSQL (MongoDB) Big Data Basics (Learn NoSQL and Store/Analyze Big Data)
4. The Fastest Full Stack: Python Backend and Web Technology Fundamentals [Full Stack Part 1]
5. Solid Front-End Fundamentals for Full-Stack: JavaScript (Vanilla JS and ES6+) and Modern Web Technologies [Full-Stack Part 2]
6. Docker and Modern Server Technologies for Full-Stack (Linux, Nginx, AWS, HTTPS, Flask Deployment) [Full-Stack Part 3]
7. Flutter Basics for Full-Stack App Development (Full-Stack Part 4, scheduled to open in the first half of 2023)
8. Full-Stack Web, PC Program, and App Development Clone Coding Series (Full-Stack Part 5, scheduled for the second half of 2023)
9. A powerful, modern backend Go language for full-stack deployments (scheduled for the second half of 2023 )
As app and web technologies are rapidly changing, we are offering React and Vue lectures to stay ahead of the latest technologies.
We will proceed with flutter, the latest technology that supports web, PC programs, and apps.

* Full-stack course packages are also available at a discounted price. (Discounts will be reduced soon.)
[Beginner to Intermediate] The easiest, most up-to-date full-stack roadmap (shortcut)

Recommended for
these people

Who is this course right for?

  • For those who want to build the basics of data science and learn crawling, a data collection technique, step by step

  • For those who want to learn intermediate Python crawling techniques

Need to know before starting?

  • Python Introduction and Crawling Basics Bootcamp

Hello
This is

33,160

Learners

2,409

Reviews

1,949

Answers

4.9

Rating

13

Courses

잔재미코딩, Dave Lee

  • About 잔재미코딩 소개 블로그 [클릭]

  • 주요 경력: 쿠팡 수석 개발 매니저/Principle Product Manager, 삼성전자 개발 매니저 (경력 약 15년)

  • 학력: 고려대 일어일문 / 연세대 컴퓨터공학 석사 (완전 짬뽕)

  • 주요 개발 이력: 삼성페이, 이커머스 검색 서비스, RTOS 컴파일러, Linux Kernel Patch for NAS

  • 저서: 리눅스 커널 프로그래밍, 리눅스 운영 체제의 이해와 개발, 누구나 쓱 읽고 싹 이해하는 IT 핵심 기술, 왕초보를 위한 파이썬 프로그래밍 입문서

  • 운영 사이트: 잔재미코딩 (http://www.fun-coding.org) [클릭]

  • 풀스택/데이터과학/AI 관련 무료 자료를 공유하는 사이트입니다.

  • 기타: 잔재미코딩 유투브 채널 [클릭] 

    • IT 학습에 도움이 되는 팁/ 짧은 무료 강의를 공유하고자, 조금씩 시작하고 있습니다~

최신 현업과 IT 강의를 병행하며, 8년째 꾸준히 견고한 풀스택, 데이터과학, AI 강의를 만들고 있습니다.

 

Curriculum

All

38 lectures ∙ (8hr 51min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

45 reviews

4.7

45 reviews

  • gjwogur122664님의 프로필 이미지
    gjwogur122664

    Reviews 10

    Average Rating 5.0

    5

    100% enrolled

    This curriculum was also very informative. It was good to be able to study and apply Python libraries and representative frameworks together :) However, time to review and internalize on your own is essential. After class, I always create problems to apply on my own and study, and my understanding seems to increase significantly. There was a time when I couldn't solve a problem I tried to solve on my own and couldn't make progress for 2 days. At the time, I was worried that my speed would slow down, but as time passed, these days actually helped me more. Dave, thank you for your great lectures!!

    • funcoding
      Instructor

      Oh, that's right. I know Heokuk's ID. The time you spent thinking about it for a long time was not a waste of time, but a necessary time. I believe that by searching for a lot of information, and by reading other articles, you will become familiar with this process and it will become your bones and flesh. It's good to see you working hard.

  • leokwon32197님의 프로필 이미지
    leokwon32197

    Reviews 9

    Average Rating 5.0

    5

    100% enrolled

    Thank you for always giving kind lectures.

    • funcoding
      Instructor

      Thank you~ I will work harder at Janjaemi Coding!!🥰

  • jayhong님의 프로필 이미지
    jayhong

    Reviews 6

    Average Rating 4.5

    5

    100% enrolled

    Thank you to Mr. Dave Lee, who creates a virtuous cycle with good lectures! This lecture is full of consideration and sincerity for the students. I highly recommend it to those who want to learn how to catch fish rather than those who want to be given fish! I will continue to cheer you on with great lectures in the future~!!

    • funcoding
      Instructor

      I sincerely thank you for sympathizing with the intention of making the lecture🥰 I will continue to do my best👍

  • smlee2836님의 프로필 이미지
    smlee2836

    Reviews 9

    Average Rating 4.8

    5

    100% enrolled

    I've been trying out various things because I'm having fun with scraping lately, and I took the Scrapy lecture. As I listened to the lecturer's explanation, I became a little interested in data analysis/science. I don't plan on becoming a data scientist yet, but I plan on taking the lecturer's next lecture. I enjoyed following along because he explained the big picture well and even told me where I could make mistakes.

    • funcoding
      Instructor

      Thank you^^ Studying with interest is bound to yield results, and in the process, you will develop and your goals will change~Let's have fun together in the next lecture!! Fighting!!

  • dostudydo님의 프로필 이미지
    dostudydo

    Reviews 5

    Average Rating 5.0

    5

    100% enrolled

    Following the first part of Crawling, I also completed the second part! At first, I was worried whether it would be right to listen to the second part because I was still not familiar with the basics of crawling, but I managed to complete the second part in one go. I took the classes while taking my children to and from school, going to work, and going on weekend outings with my family, so I feel a sense of accomplishment for completing the course. For now, I plan to continue listening to the lectures up to Pandas, and in the future, I plan to reduce the time I spend listening to the lectures and spend more time internalizing the crawling techniques I have learned so far by applying them one by one to the sites I want to crawl. I think learning Pandas will definitely help me a lot when I work~ I can't get full on the first try, so I plan to do it little by little for the next three years. I'm sure good things will happen. I hope you always stay healthy, and please make many good lectures in the future! Thank you!

    • funcoding
      Instructor

      Wow, congratulations on completing the second part!! I'm sure you'll get good results as you work hard~ Consistency is a great weapon^^

funcoding's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!