The Most Powerful Crawling Technology Today: Mastering Scrapy and Selenium
For those who want to learn data science, big data, and crawling - We have prepared a variety of examples to help you quickly learn the latest and best crawling techniques available.
1,261 learners
Level Intermediate
Course period Unlimited
[Sharing Tips] When selenium does not run
Hello, this is Dave Lee. Happy New Year.
There may be cases where Selenium does not run depending on the PC environment. I will share some methods to try in this regard.
First of all, a student shared a case where Chrome() can be executed on Windows by entering the executable_path as follows. (Please change the C:/path/ part to the exact name of the folder where chromedriver.exe is located.) Thank you!
-------------------------------------------------- ---
driver = webdriver.Chrome( executable_path=r"C:/path/chromedriver.exe" )
-------------------------------------------------- ---
Also, in the case of Mac environments, after updating Mac OS to Catalina, I found that the existing chromedriver does not run due to security issues. There is a way to change the security settings, but in this case, I think it would be good to simply move chromedriver to the /usr/local/bin directory and run it. If this part does not work, please visit the following site that I shared in the lecture.
https://sites.google.com/a/chromium.org/chromedriver/
If you download the new chromedriver, move the executable file to the /usr/local/bin directory, and run it as follows, it will run normally.
-------------------------------------------------- ---
from selenium import webdriver
chromedriver = '/usr/local/bin/chromedriver'
driver = webdriver.Chrome(chromedriver)
-------------------------------------------------- ---
I hope you find these tips helpful. Thanks.