如何从具有多个标准选项的动态图表中通过 XPath 进行 web 抓取？

Question

I am very new to scraping and programing in general. That's why I am asking for help with the next issue. There is a web site under the url. I need to get data from dynamic charts. The code has to be written with an option of looping through all the required days data represented for and an option of looping though all elements containing the data.

First issue is that I need somehow to get the data following the XPath. And the second one is that I have to write the loop to get all the required inflammation

url = "https://www.oree.com.ua/index.php/control/results_mo/DAM"


from selenium import webdriver
import requests
import pandas as pd
import time



browser = webdriver.PhantomJS(executable_path = "C:/ProgramData/Anaconda3/Lib/site-packages/phantomjs-2.1.1-windows/bin/phantomjs")
browser.get(url)
time.sleep(2)


elements = browser.find_elements_by_xpath("html/body/div[5]/div[1]/div[3]/div[3]/div/div/table/tbody/tr[1]/td[3]/text()")
for element in elements:
    print(element)

browser.quit()

Answer 1

Not sure Selenium is required here. You can get directly data from this mixed html/json object (change the date accordingly to your needs):

https://www.oree.com.ua/index.php/PXS/get_pxs_hdata/04.04.2020/DAM/1

Then request with:

//tbody//tr/td[i]

Where i is the column of interest. Range of i is 3-7. Column 3 is "Sales volume, MW.h", 4 is "Purchase volume, MW.h", etc...

Output for sales volume (04/04/2020):