Python 雅虎財經-數據抓取

Question

我是編程新手，我只是想獲得“目標價格：來自雅虎金融的價值我試過 beautifulsoup、xpath ......但在以下示例中從未成功提取數據（241.21 美元）

例如： https://finance.yahoo.com/quote/MSFT/analysis?p=MSFT

目標價區域

import requests
from bs4 import BeautifulSoup as bs
ticker = 'MSFT'
url ='https://finance.yahoo.com/quote/'+Symbol
page = requests.get(url)
soup = bs(page.text, "html.parser")
for row in table:
    col = row.find_all('span')
    for c in col:
        print(c.text)

打印所有跨度時，它不顯示...

Answer 1

我開發了以下示例來抓取您感興趣的數據。這些數據特別難以獲得，因為只有在頁面向下滾動足夠多時才由 javascript 填寫。

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from bs4 import BeautifulSoup
    
driver = webdriver.Chrome()
driver.get('https://finance.yahoo.com/quote/MSFT/analysis?p=MSFT')

# Scroll down to the container of the data. The Analyst Price Targets div.
# The needed data is not filled in until scrolled down
driver.execute_script("""document.querySelector('div#Aside div[data-reactid="48"]').scrollIntoView();""")

# Get the span that contains the data
elem = driver.find_element_by_xpath("//div[@data-test='analyst-avg-tg']//span[2]")
print(elem.text)