在尝试抓取 React 网站时获取 index.html 内容

Question

when i try to scrape a reactjs website using nodejs i am getting the content of index.html file only not the tags that were used in the website. Here is what i have tried -

    const request = require("request");
    const cheerio = require("cheerio");

    const URL = "https://pydata-jal.netlify.com/";

    request(URL, (err, res, body) => {
      if (!err && res.statusCode == 200) {
        const $ = cheerio.load(body);
        console.log($.html());
      }
    });

What should i do to get the whole of tags that were used in react website.

And do tell i can scrape the hackernoon website ? (for just example) if its legal?

Answer 1

Cheerio 只解析已经渲染的 HTML（例如：静态 HTML）为了获得 React 渲染，你应该依赖于像Puppeteer这样的工具控制的无头浏览器