NoSuchElementException：消息：沒有這樣的元素：無法找到元素：{"method":"css selector","selector":"[id="events_table"]"}

Question

需要從https://www.ncei.noaa.gov/access/billions/events刮一張桌子。 網站上有下載表格的鏈接，但下載的文件沒有“摘要”列。 嘗試使用以下代碼來抓取表格：

url = 'https://www.ncei.noaa.gov/access/billions/events'
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager

driver = webdriver.Chrome(ChromeDriverManager().install())
driver.maximize_window()
driver.implicitly_wait(30)
driver.get(url)
df=pd.read_html(driver.find_element_by_id("events_table").get_attribute('outerHTML'))[0]

但有錯誤

NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"[id="events_table"]"}
  (Session info: chrome=102.0.5005.61)

而我手動檢查我的 mac 上的 chrome 版本是100.0.4896.127 。

檢查表組件，發現表 id 是events_table

Answer 1

是必須使用find_element_by_id還是您可以使用find_element_by_xpath ？ 因為如果您要使用find_element_by_xpath並提供 id，則此方法有效：

df=pd.read_html(driver.find_element_by_xpath('//*[@id="events-table"]').get_attribute('outerHTML'))[0]

結果：

                                                 Event  ... Deaths
0                                Western Wildfires2021  ...      8
1                   Western Drought and Heat Wave2021†  ...    229
2    Midwest Derecho and Tornado OutbreakDecember 2...  ...      1
3    Southeast, Central Tornado OutbreakDecember 2021†  ...     93
4                    Hurricane NicholasSeptember 2021†  ...      0
..                                                 ...  ...    ...
318  Severe Storms, Flash Floods, Hail, TornadoesMa...  ...     20
319                         Florida FreezeJanuary 1981  ...      0
320  Central/ Eastern Drought/ Heat WaveSummer-Fall...  ...   1260
321                         Hurricane AllenAugust 1980  ...     13
322      Southern Severe Storms and FloodingApril 1980  ...      7