在 Selenium Python 中查找一个 class 名字的所有元素
[英]Find all elements of a class name in Selenium Python
问题描述
I'm trying to extract all ads from this page https://www.centris.ca/en/properties~for-rent?view=Thumbnail and then click on them to extract data.
我正在尝试从此页面https://www.centris.ca/en/properties~for-rent?view=Thumbnail中提取所有广告，然后单击它们以提取数据。
For some reason, I can only extract the first entry despite using "find_elements".出于某种原因，尽管使用了“find_elements”，但我只能提取第一个条目。
Here is my code:这是我的代码：
from selenium import webdriver
driver = webdriver.Chrome()
driver.get("https://www.centris.ca/en/properties~for-rent?view=Thumbnail")
list = driver.find_elements_by_xpath("//div[contains(@class, 'thumbnailItem col-12 col-sm-6 col-md-4 col-lg-3')]")
print(list)
for l in list:
l.click()
What is the proper way to extract all elements with xpath (or other methods)?使用 xpath（或其他方法）提取所有元素的正确方法是什么？
1 个解决方案
解决方案1
1 已采纳 2020-08-04 09:36:07
To extract the href attribute of all the ads from this page https://www.centris.ca/en/properties~for-rent?view=Thumbnail you need to induce WebDriverWait for the visibility_of_all_elements_located() and you can use either of the following Locator Strategies :要从此页面https://www.centris.ca/en/properties~for-rent?view=Thumbnail中提取所有广告的href属性，您需要为visibility_of_all_elements_located()引入WebDriverWait ，您可以使用以下任一方法以下定位器策略：
Using
CSS_SELECTOR:使用CSS_SELECTOR：driver.get("https://www.centris.ca/en/properties~for-rent?view=Thumbnail") print([my_elem.get_attribute("href") for my_elem in WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, "div[data-id='templateThumbnailItem'] a")))])Using
XPATH:使用XPATH：driver.get("https://www.centris.ca/en/properties~for-rent?view=Thumbnail") print([my_elem.get_attribute("href") for my_elem in WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.XPATH, "//div[@data-id='templateThumbnailItem']//a")))])Console Output:
控制台 Output：['https://www.centris.ca/en/lofts-studios~for-rent~quebec-la-cite-limoilou/22499659?view=Summary', 'https://www.centris.ca/en/lofts-studios~for-rent~quebec-la-cite-limoilou/22499659?view=Summary', 'https://www.centris.ca/en/lofts-studios~for-rent~quebec-la-cite-limoilou/22499659?view=Summary', 'https://www.centris.ca/en/lofts-studios~for-rent~quebec-la-cite-limoilou/22499659?view=Summary', 'https://www.centris.ca/en/lofts-studios~for-rent~quebec-la-cite-limoilou/22499659?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12049555?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12049555?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12049555?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12049555?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12049555?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/23940814?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/23940814?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/23940814?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/23940814?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/23940814?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/27006991?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/27006991?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/27006991?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/27006991?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/27006991?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~levis-desjardins/19288399?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~levis-desjardins/19288399?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~levis-desjardins/19288399?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~levis-desjardins/19288399?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~levis-desjardins/19288399?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~mont-tremblant/17619353?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~mont-tremblant/17619353?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~mont-tremblant/17619353?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~mont-tremblant/17619353?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~mont-tremblant/17619353?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-sainte-foy-sillery-cap-rouge/21825148?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-sainte-foy-sillery-cap-rouge/21825148?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-sainte-foy-sillery-cap-rouge/21825148?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-sainte-foy-sillery-cap-rouge/21825148?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-sainte-foy-sillery-cap-rouge/21825148?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/21424641?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/21424641?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/21424641?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/21424641?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/21424641?view=Summary', None, 'https://www.centris.ca/en/condos~for-sale~bromont/26233302?view=Summary', 'https://www.centris.ca/en/condos~for-sale~bromont/26233302?view=Summary', 'https://www.centris.ca/en/condos~for-sale~bromont/26233302?view=Summary', 'https://www.centris.ca/en/condos~for-sale~bromont/26233302?view=Summary', 'https://www.centris.ca/en/condos~for-sale~bromont/26233302?view=Summary', None, 'https://www.centris.ca/en/houses~for-rent~westmount/17444501?view=Summary', 'https://www.centris.ca/en/houses~for-rent~westmount/17444501?view=Summary', 'https://www.centris.ca/en/houses~for-rent~westmount/17444501?view=Summary', 'https://www.centris.ca/en/houses~for-rent~westmount/17444501?view=Summary', 'https://www.centris.ca/en/houses~for-rent~westmount/17444501?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~laval-chomedey/19011333?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~laval-chomedey/19011333?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~laval-chomedey/19011333?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~laval-chomedey/19011333?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~laval-chomedey/19011333?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~brossard/20981895?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~brossard/20981895?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~brossard/20981895?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~brossard/20981895?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~brossard/20981895?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/11477282?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/11477282?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/11477282?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/11477282?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-le-sud-ouest/11477282?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12730891?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12730891?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12730891?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12730891?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/12730891?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/14530697?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/14530697?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/14530697?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/14530697?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/14530697?view=Summary', None, 'https://www.centris.ca/en/houses~for-rent~blainville/20565674?view=Summary', 'https://www.centris.ca/en/houses~for-rent~blainville/20565674?view=Summary', 'https://www.centris.ca/en/houses~for-rent~blainville/20565674?view=Summary', 'https://www.centris.ca/en/houses~for-rent~blainville/20565674?view=Summary', 'https://www.centris.ca/en/houses~for-rent~blainville/20565674?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-la-cite-limoilou/17234044?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-la-cite-limoilou/17234044?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-la-cite-limoilou/17234044?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-la-cite-limoilou/17234044?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~quebec-la-cite-limoilou/17234044?view=Summary', None, 'https://www.centris.ca/en/houses~for-sale~montreal-ville-marie/17988959?view=Summary', 'https://www.centris.ca/en/houses~for-sale~montreal-ville-marie/17988959?view=Summary', 'https://www.centris.ca/en/houses~for-sale~montreal-ville-marie/17988959?view=Summary', 'https://www.centris.ca/en/houses~for-sale~montreal-ville-marie/17988959?view=Summary', 'https://www.centris.ca/en/houses~for-sale~montreal-ville-marie/17988959?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~sainte-julie/14344430?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~sainte-julie/14344430?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~sainte-julie/14344430?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~sainte-julie/14344430?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~sainte-julie/14344430?view=Summary', None, 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/28728702?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/28728702?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/28728702?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/28728702?view=Summary', 'https://www.centris.ca/en/condos-apartments~for-rent~montreal-ville-marie/28728702?view=Summary', None]Note : You have to add the following imports:
注意：您必须添加以下导入：from selenium.webdriver.support.ui import WebDriverWait from selenium.webdriver.common.by import By from selenium.webdriver.support import expected_conditions as EC
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
硒用python挂在按类名的查找元素上 - selenium hangs at find elements by class name with python
Selenium 按 Class 名称错误查找元素（Python） - Selenium Find Elements by Class Name Bug (Python)
Python / Selenium-具有长类名的find_elements_by_class_name - Python/Selenium - find_elements_by_class_name with long class name
使用Python在Selenium中使用find_elements_by_class_name查找href属性 - Find href attributes with find_elements_by_class_name in Selenium with Python
Python：Selenium WebDriver find_elements_by_class_name - Python: Selenium WebDriver find_elements_by_class_name
Python硒webdriver。 查找具有指定类名的元素 - Python selenium webdriver. Find elements with specified class name
Python Selenium find_elements_by_class_name 错误 - Python Selenium find_elements_by_class_name Error
如何让 find_elements_by_class_name 在 Python Selenium 中工作？ - How to get find_elements_by_class_name to work in Python Selenium?
Selenium Python | 'find_elements_by_class_name' 不返回任何内容 - Selenium Python | 'find_elements_by_class_name' returns nothing
使用Selenium / Python 2.7无法按类名称查找元素 - Unable to find elements by class name using Selenium/Python 2.7
相关标签