如何使用 Js 获取 html 页面（元素）

Question

I am trying to fetch a content of a page. When I inspect and go under the 'Elements' section, I can see the needed data in span tag for example, but when I try to fetch which I do as a get request to the url, I receive different HTML that doesn't contain the same data but less.

This is how I try to fetch my data

async function fetchData(url)
{
  const response = await axios.get(url);
  console.log(response.data)
}

What would be the reason of the difference and how could I solve it?

Should I use different technique?

Answer 1

Well, indeed, crawlers are supposed to use parsing tools, like Puppeteer library or Cheerio for data-grabbing.

Here are some references:

github puppeteer

npm puppeteer

I've tried to do something like that a few times ago. If you're having troubles - ask for help