강의

멘토링

커뮤니티

BEST
Data Science

/

Data Engineering

Easy Python Advanced Crawling [Scrapy, Selenium, Headless Chrome]

For those who want to learn data science, big data, and crawling - We've designed it so that you can quickly learn the latest and best crawling technologies with various examples.

(4.7) 45 reviews

866 learners

  • funcoding
"쉽지만 가볍지 않습니다"
Web Crawling
Scrapy
Selenium
Big Data

Reviews from Early Learners

What you will gain after the course

  • Intermediate Python Crawling Techniques

  • Scrapy Crawling Framework Technology

  • Dynamic web page crawling technology

  • Selenium, Headless Chrome Crawling Technology

The official lecture chosen by Nekarakubae as an in-house lecture! 
For data science/analytics careers
Learn the latest Python crawling collection techniques
Highly complete lectures

This course builds on the Python Introduction and Crawling Basics bootcamp courses, systematically mastering intermediate crawling and Python data collection techniques. Designed to be used alongside professional work, this course is designed with the student's perspective in mind, unlike typical IT lectures . In addition to the lectures, you'll learn each function one by one, allowing you to quickly master the material and further develop your data processing capabilities .

This course is designed for those who have completed the Python Introduction and Crawling Basics bootcamp courses. It focuses on intermediate data collection techniques. It's designed for those considering careers in data science/analysis or full-stack development.

How do I build the foundation for a data analytics/science career?
  • You should learn Python and go through the entire data analysis process.
  • You can learn data collection, data storage, data analysis, and data prediction in order, step by step. Since the entire process is done in Python in the workplace, you can learn the entire process using Python.
  • This course is designed to teach you intermediate data collection techniques. It utilizes the crawling and basic Python skills learned in the Python Introduction and Crawling Basics bootcamps, and further teaches you the latest data collection technologies, Selenium and the Scrapy framework.

You need to cover the entire data science process!
You can learn the basics of handling data.

What are the Selenium and Scrapy frameworks?
  • In the Python Introduction and Crawling Basics Bootcamp , I learned basic Python programming syntax and crawling techniques to automatically collect various data from web pages based on the bs4 library.
  • However, these days, webpage creation technologies are diverse. Broadly speaking, they can be divided into static and dynamic webpages. Data collection from dynamic webpages is difficult using basic crawling techniques.
  • Selenium is a technology that can collect data from dynamic web pages. It can also automatically collect data from web pages that require specific actions, such as logging in, or from pages that require data to be retrieved after performing a specific action.
  • Additionally, the Scrapy framework is a technology used for professionally collecting large amounts of data. It offers a variety of features and, most importantly, boasts fast crawling speeds.

In this lecture, in addition to Selenium and Scrapy,
We also cover other crawling techniques, Headless Chrome and XPATH!
This course will help you master the basics of crawling, along with an introduction to Python and a crawling bootcamp.

* This course leverages the Python programming, IT fundamentals, and crawling skills learned in the Python Introduction and Crawling Basics bootcamps. By further exploring the Selenium and Scrapy frameworks, you'll not only solidify your existing skills through repetition, but also approach them from different angles, mastering all existing data collection techniques and solidifying your foundation in Python and data science data collection.


To help you become familiar with relevant application techniques in a short period of time
We provide lectures based on various codes and materials, step-by-step and technology-specific.

Don't waste your time!
It's not that we can't do something because we don't have the information!
Learn with proven courses!

Have you ever paid millions of won for a course that only taught grammar? We've designed the course to naturally build a solid foundation by providing practice problems and code patterns to help you become familiar with the concepts, ensuring they become ingrained in your brain and readily applicable to real-world applications.

This lecture is an improved version of the previous lecture.

We've designed this course to complement the shortcomings of existing lectures and provide more practice.
For this course, we've created a test site specifically for you to use and test various intermediate crawling techniques.

So that you can feel, 'Ah! It's really different!'
This is a lecture that is created through constant thought and improvement.

Be reasonable and considerate of each other
Only those who can form good relationships
Please take the class!

We're creating a roadmap to help you build the fundamentals step by step to prepare for a data and full-stack career.

Data Analytics/Science Course: Building a Solid Foundation for Data Analysts and Scientists

They are numbered according to the order in which they are learned.

  1. Introduction to Python and Data Collection (Crawling) Basics (Python, the Web, and Data Understanding Basics)
  2. Easy, Advanced Python Crawling for Beginners (Professional Crawling Techniques, Not Included in Data Roadmap)
  3. SQL and Data Storage/Analysis Basics (Learn SQL and store/analyze data)
  4. NoSQL (MongoDB) Big Data Basics (Learn NoSQL and Store/Analyze Big Data)
  5. Beginner Python Data Analysis (Data Preprocessing, Pandas, and Modern Visualization) [Data Science Part 1]
  6. Beginner Python Machine Learning Bootcamp (Easy! Learn concepts and applications through real-world problems) [Data Science Part 2]
  7. Deep Learning and PyTorch Bootcamp for Beginners [Data Science Part 3]

* We are also offering our current data science course packages at a discounted price (the discount will be reduced soon)
[Introductory to Beginner] Easily and Thoroughly Master the Basics of Data Science for Employment (Shortcut)

Full Stack Course: A Tech Tree to Create the Latest Web/App Services from A to Z on Your Own

They are numbered according to the order in which they are learned.

1. Python and Data Collection (Crawling) Basics (Python and the Web, Data Understanding Basics)
2. MySQL and Data Storage/Analysis Basics (Learn SQL and store/analyze data)
3. NoSQL (MongoDB) Big Data Basics (Learn NoSQL and Store/Analyze Big Data)
4. The Fastest Full Stack: Python Backend and Web Technology Fundamentals [Full Stack Part 1]
5. Solid Front-End Fundamentals for Full-Stack: JavaScript (Vanilla JS and ES6+) and Modern Web Technologies [Full-Stack Part 2]
6. Docker and Modern Server Technologies for Full-Stack (Linux, Nginx, AWS, HTTPS, Flask Deployment) [Full-Stack Part 3]
7. Flutter Basics for Full-Stack App Development (Full-Stack Part 4, scheduled to open in the first half of 2023)
8. Full-Stack Web, PC Program, and App Development Clone Coding Series (Full-Stack Part 5, scheduled for the second half of 2023)
9. A powerful, modern backend Go language for full-stack deployments (scheduled for the second half of 2023 )
As app and web technologies are rapidly changing, we are offering React and Vue lectures to stay ahead of the latest technologies.
We will proceed with flutter, the latest technology that supports web, PC programs, and apps.

* Full-stack course packages are also available at a discounted price. (Discounts will be reduced soon.)
[Beginner to Intermediate] The easiest, most up-to-date full-stack roadmap (shortcut)

Recommended for
these people

Who is this course right for?

  • For those who want to build the basics of data science and learn crawling, a data collection technique, step by step

  • For those who want to learn intermediate Python crawling techniques

Need to know before starting?

  • Python Introduction and Crawling Basics Bootcamp

Hello
This is

33,118

Learners

2,399

Reviews

1,949

Answers

4.9

Rating

13

Courses

잔재미코딩, Dave Lee

  • About 잔재미코딩 소개 블로그 [클릭]

  • 주요 경력: 쿠팡 수석 개발 매니저/Principle Product Manager, 삼성전자 개발 매니저 (경력 약 15년)

  • 학력: 고려대 일어일문 / 연세대 컴퓨터공학 석사 (완전 짬뽕)

  • 주요 개발 이력: 삼성페이, 이커머스 검색 서비스, RTOS 컴파일러, Linux Kernel Patch for NAS

  • 저서: 리눅스 커널 프로그래밍, 리눅스 운영 체제의 이해와 개발, 누구나 쓱 읽고 싹 이해하는 IT 핵심 기술, 왕초보를 위한 파이썬 프로그래밍 입문서

  • 운영 사이트: 잔재미코딩 (http://www.fun-coding.org) [클릭]

  • 풀스택/데이터과학/AI 관련 무료 자료를 공유하는 사이트입니다.

  • 기타: 잔재미코딩 유투브 채널 [클릭] 

    • IT 학습에 도움이 되는 팁/ 짧은 무료 강의를 공유하고자, 조금씩 시작하고 있습니다~

최신 현업과 IT 강의를 병행하며, 8년째 꾸준히 견고한 풀스택, 데이터과학, AI 강의를 만들고 있습니다.

 

Curriculum

All

38 lectures ∙ (8hr 51min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

45 reviews

4.7

45 reviews

  • 허쿡님의 프로필 이미지
    허쿡

    Reviews 10

    Average Rating 5.0

    5

    100% enrolled

    역시 이번 커리큘럼도 알찬 내용들이였습니다. 파이썬 라이브러리와 대표적인 프레임워크를 같이 공부하고 적용해볼 수 있어서 좋았습니다 :) 하지만 역시나 스스로 복습해서 체화시키는 시간이 꼭 필요합니다. 강의 끝나고 항상 스스로 적용시켜볼 문제들을 만들어서 공부해보니 이해도가 훨씬 높아지는 것 같습니다. 스스로 풀어보려고 한 문제가 안 풀려서 2일 동안 진도를 못 나간 적이 있는데 당시에는 속도가 더뎌질까 걱정했지만 시간이 지나니 오히려 이런 날들이 더 도움이 되었습니다. 데이브님 좋은 강의 항상 감사합니다.!!

    • 잔재미코딩 DaveLee
      Instructor

      아 맞습니다. 허쿡님은 아이디를 제가 알고 있어요. 오랜동안 고민한 그 시간이 아까운 시간이 아니라 꼭 필요한 시간이더라고요. 많은 자료를 찾아보며, 검색이 질릴정도로, 다른 글을 읽어보는 것이 질릴정도가 여러번 되면서, 어느날 조금씩 그런 과정이 익숙해지고, 뼈가되고 살이 되실꺼라 믿습니다. 열심히 하시는 모습 보기 좋습니다.

  • 권성민님의 프로필 이미지
    권성민

    Reviews 9

    Average Rating 5.0

    5

    100% enrolled

    항상 친절한 강의 감사합니다

  • Jay님의 프로필 이미지
    Jay

    Reviews 6

    Average Rating 4.5

    5

    100% enrolled

    좋은강의로선순환을 만들어 가시는 Dave Lee 선생님께 감사드립니다! 수강자들을 위한 고민과 정성이 깃들어 있는 강의입니다. 생선을 물어다 주기를 바라는 분들보다는 생선잡는 법을 배우고 싶으신 분들께 강추 입니다! 앞으로도 좋은강의 기대하며 응원하겠습니다~!!

    • 강의제작 의도에 공감해주셔서 진심으로 감사드려요🥰 앞으로도 최선을 다하겠습니다👍

  • smlee님의 프로필 이미지
    smlee

    Reviews 9

    Average Rating 4.8

    5

    100% enrolled

    요즘 스크래핑이 재미있어서 이것저것 해보고 있다가, Scrapy를 강의하시기에 들었는데요. 강사님의 설명을 듣다보니, 데이터 분석/과학에 대해서도 약간의 관심이 생기네요. 아직 데이터 과학자가 되겠다는 생각은 없지만, 강사님의 다음 강의도 수강해 볼 예정입니다. 큰 흐름을 잘 설명해 주시고, 오류를 낼 수 있는 부분까지 알려주셔서 재미나게 따라왔습니다.

    • 감사합니다^^ 흥미를 갖고 하는 공부는 성과가 나오기 마련이더라구요 그러면서 발전도하고 목표에 변화가 생기기도 하구요~다음 강의도 우리 함께 재미있게 해봐요!! 홧팅!!

  • dostudydo님의 프로필 이미지
    dostudydo

    Reviews 5

    Average Rating 5.0

    5

    100% enrolled

    크롤링 1편에 이어 2편도 완강했습니다! 처음에는 크롤링 기본도 아직 익숙하지 않은 상태인지라, 2편을 이어서 듣는게 맞는지 고민이 됐었지만, 그래도 2편까지 단번에 완강을 해냈습니다. 등하원 시키면서 회사도 다니고, 가족들과 주말 나들이도 다니면서 틈틈히 강의를 수강해 나간지라 완강에 대한 성취감이 이루말할 수 없네요. 일단 강의 듣는 것은 판다스까지 쭈욱 이어갈 계획이고, 앞으로는 강의 듣는 시간을 줄이고, 지금까지 배워온 크롤링 기술들을 제가 크롤링하고 싶은 사이트에 하나씩 적용해 나가며 내재화 시키는 시간을 좀더 많이 가져가볼까 합니다. 아무래도 판다스까지 배워놓으면 확실히 일할때 많은 도움이 될거 같긴하네요~첫술에 배부를 순 없고, 일단 앞으로 3년 꾸준히 조금씩 해보려고 합니다. 분명 좋은 일들이 생기겠죠? 선생님께서도 항상 건강하시고, 앞으로 좋은 강의 많이 많이 만들어주세요! 감사합니다!

    • 와우 2편까지 완강축하드려요!! 열심히 하시는 만큼 좋은 결과 있으실거예요~꾸준함은 큰 무기가 된답니다^^

funcoding's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!