简体   繁体   中英

Web scraping from html that gets added on button press

Im trying to scrape data from a page that has a huge table, the table shows 100 entries as default. There is a select/option at the bottom that lets you change the entries to 200 or All.

How do I set the selecter to All before scraping the table as I want to scrape from all entries, not just the first 100.

Im using node.js/JavaScript to scrape from the page.

The table, that is displayed on the link you provided in the comments gets filled by a JSON file. You can acces the JSON-File directly under this path .

There is the data you needed, provided in a clean and easy JSON file. You can parse it and get all information you need.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM