簡體   English   中英

用硒刮評論

[英]Scraping reviews with selenium

我正在使用Pycharm,並且出現錯誤

:selenium.common.exceptions.WebDriverException: Message: unknown error: Element <a 

我正在嘗試通過轉到class="quote"的href鏈接來進行安全性審查

錯誤

from selenium import webdriver
import pandas as pd
import re
import time

driver = webdriver.Chrome("C:\\Users\\tanmay\\Downloads\\chromedriver.exe")
driver.get("https://www.tripadvisor.in/Hotel_Review-g304551-d299120-Reviews-or10-The_Lalit_New_Delhi-New_Delhi_National_Capital_Territory_of_Delhi.html")

print("Name :",driver.find_element_by_id("HEADING").text)

driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")
driver.find_element_by_xpath("//*[@id='TABS_REVIEWS']/span").click()
Element = driver.find_element_by_class_name("query_elem")
Element.send_keys("Safety")
driver.find_element_by_css_selector('.ui_icon.search.search-icon').click()
driver.execute_script("window.scrollTo(0,2050);")
driver.implicitly_wait(0.1)
time.sleep(0.1)

div = driver.find_element_by_class_name("quote")
div.find_element_by_css_selector('a').click()
from selenium import webdriver
from selenium.webdriver.common.keys import Keys

driver = webdriver.Chrome("#path")
driver.get("https://www.tripadvisor.in/Hotel_Review-g304551-d299120-Reviews-or10-The_Lalit_New_Delhi-New_Delhi_National_Capital_Territory_of_Delhi.html")

driver.find_element_by_class_name("query_elem").clear()
search_bar = driver.find_element_by_class_name("query_elem")
search_bar.send_keys('Safety')
search_bar.send_keys(Keys.ENTER)

# Below are the hrefs.
for div in driver.find_elements_by_class_name('quote'):
    a = div.find_element_by_class_name('title')
    print(a.get_attribute('href'))

# Click on the nav for next page
# go to next page
next_page = driver.find_element_by_class_name('next')
next_page.click()

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM