The Most Powerful Crawling Technology Today: Mastering Scrapy and Selenium
For those who want to learn data science, big data, and crawling - We have prepared a variety of examples to help you quickly learn the latest and best crawling techniques available.
1,261 learners
Level Intermediate
Course period Unlimited
[Share] Lecture Update
hello.
This is Dave Lee from Jjanjaemi Coding.
The video 'Learn how to use Scrapy in real life by crawling Gmarket 5' has been updated with additional explanations.
There is a code explanation for the part in the video that calls parse_subcategory.
If you write this code yourself other than the code I provided, you will need to set the following in addition to settings.
DUPEFILTER_CLASS = 'scrapy.dupefilters.BaseDupeFilter'
I think I explained this part somewhere in another video,
I spent a lot of time re-recording and editing it again, just in case I missed something.
I'm sharing this because I think it will help you understand better.
thank you