[英]How to get selenium web driver on python to find elements on css selectors of a following page?
I am trying to get selenium to web scrape the first paragraph of wiki pages using CSS selectors.我试图让 selenium 到 web 使用 CSS 选择器刮掉维基页面的第一段。
When I run this code, it seems to only select ones from the original web page当我运行此代码时,似乎只有 select 来自原始 web 页面
and not what I am searching for, in this case 'cats'.而不是我正在寻找的东西,在这种情况下是“猫”。
Any help with this would be awesome!对此的任何帮助都会很棒!
browser = webdriver.Firefox(executable_path='D:\Import Files that I also want backed up\Jupyter Notebooks\Python Projects\Selenium\driverss\geckodriver.exe')
browser.get('https://en.wikipedia.org')
search_elem = browser.find_element_by_css_selector('#searchInput')
search_elem.send_keys('cats')
search_elem.submit()
results_elem = browser.find_element_by_css_selector('p')
print(results_elem.text)
output:
Adventure Time is an American fantasy animated television series created .....
To get the first paragraph text from wiki page.Induce WebDriverWait()
and visibility_of_element_located
() and following css
selector.从 wiki 页面获取第一段文本。Induce WebDriverWait()
和visibility_of_element_located
() 并遵循css
选择器。
from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
browser = webdriver.Firefox(executable_path='D:\Import Files that I also want backed up\Jupyter Notebooks\Python Projects\Selenium\driverss\geckodriver.exe')
browser.get('https://en.wikipedia.org')
search_elem = browser.find_element_by_css_selector('#searchInput')
search_elem.send_keys('cats')
search_elem.submit()
results_elem=WebDriverWait(browser,10).until(EC.visibility_of_element_located((By.CSS_SELECTOR,"div.mw-parser-output p:nth-of-type(3)")))
print(results_elem.text)
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.