未创建 Chrome 驱动程序会话 - 硒网络抓取

Question

I'm doing some web scraping on a js rendered website using python. Here is my code:

import selenium
url2 = 'https://www.adviserratings.com.au/find-an-adviser/'
driver = webdriver.Chrome()
driver.get(url2)

I've done a lot of research, and most of the similar problems are caused by Chrome diver version or Chrome version.

I'm pretty sure my chrome driver and chrome version are correct. But it still shows the error message as below:

SessionNotCreatedException: Message: session not created
from disconnected: unable to connect to renderer
(Session info: chrome=70.0.3538.77)
(Driver info: chromedriver=2.43.600210 
(68dcf5eebde37173d4027fa8635e332711d2874a),platform=Windows NT 10.0.14393 
x86_64)

It will launch a chrome but unable to open anything, after a few seconds, it will be closed and pop up with error message

Here is the screenshot

Anyone can help?

Thanks a lot!

Answer 1

The script below works perfectly fine for me.

from selenium import webdriver
from selenium.common.exceptions import TimeoutException
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.support.wait import WebDriverWait
from bs4 import BeautifulSoup
import time
from time import sleep
browser = webdriver.Chrome("C:/Utility/chromedriver.exe")

wait = WebDriverWait(browser, 10)

url = 'https://www.nissanusa.com/dealer-locator.html'
browser.get(url)
time.sleep(10) # wait page open complete

html = browser.page_source
soup = BeautifulSoup(html, "html.parser")

data = soup.findAll('div',attrs={'class':'dealers-view'})
for div in data:
    links = div.findAll('a')
    for a in links:
        print(a['href'])

You know you have to put in the path to the chromedriver.exe, right. Finally, the URL that you posted doesn't really have a lot of material worthy of screen scraping. Usually people try to get lists, or data from tables, or some such thing.