在python中进行网络抓取时在HTML中找到正确的标签

Question

Im working on a project for school were I display the current price for bitcoin, eth and maybe another and im web scraping https://cryptowat.ch/ but I cant find the tag used to store the live price. when i parse the div tag it returns the price but im not able to isolate it so i can display it in python

<div class="rankings-col__header__segment"><h2>BTC</h2><weak>usd </weak>10857.00</div>

Answer 1

From what I understand - you know the BTC string and can use it to base your locator.

So, if it would be XPath, you can use that and following-sibling::text() :

//h2[. = 'BTC']/following-sibling::text()

Example using lxml.html :

from lxml.html import fromstring

data = """<div class="rankings-col__header__segment"><h2>BTC</h2><weak>usd </weak>10857.00</div>"""

root = fromstring(data)
print(root.xpath("//h2[. = 'BTC']/following-sibling::text()"))

Prints ['10857.00'] .

---

If, by any chance, you use BeautifulSoup , it would be:

from bs4 import BeautifulSoup


data = """<div class="rankings-col__header__segment"><h2>BTC</h2><weak>usd </weak>10857.00</div>"""

soup = BeautifulSoup(data, "html.parser")
print(soup.find("h2", string="BTC").find_next_sibling(text=True))