๊ฐ•์˜

๋ฉ˜ํ† ๋ง

๋กœ๋“œ๋งต

The Most Powerful Crawling Technology Today: Mastering Scrapy and Selenium

For those who want to learn data science, big data, and crawling - We have prepared a variety of examples to help you quickly learn the latest and best crawling techniques available.

(4.9) 112 reviews

1,261 learners

Level Intermediate

Course period Unlimited

Web Crawling
Web Crawling
Scrapy
Scrapy
Selenium
Selenium
Web Crawling
Web Crawling
Scrapy
Scrapy
Selenium
Selenium

[Sharing Tips] When selenium does not run

Hello, this is Dave Lee. Happy New Year.

There may be cases where Selenium does not run depending on the PC environment. I will share some methods to try in this regard.

First of all, a student shared a case where Chrome() can be executed on Windows by entering the executable_path as follows. (Please change the C:/path/ part to the exact name of the folder where chromedriver.exe is located.) Thank you!

-------------------------------------------------- ---

driver = webdriver.Chrome( executable_path=r"C:/path/chromedriver.exe" )

-------------------------------------------------- ---

Also, in the case of Mac environments, after updating Mac OS to Catalina, I found that the existing chromedriver does not run due to security issues. There is a way to change the security settings, but in this case, I think it would be good to simply move chromedriver to the /usr/local/bin directory and run it. If this part does not work, please visit the following site that I shared in the lecture.

https://sites.google.com/a/chromium.org/chromedriver/

If you download the new chromedriver, move the executable file to the /usr/local/bin directory, and run it as follows, it will run normally.

-------------------------------------------------- ---

from selenium import webdriver

chromedriver = '/usr/local/bin/chromedriver'

driver = webdriver.Chrome(chromedriver)

-------------------------------------------------- ---

I hope you find these tips helpful. Thanks.

Comment