page.evaluate() 和 document.querySelectorAll() 返回未定义或空数组

Question

I am trying to scrape the web responses from this site https://chat.kuki.ai/ using Puppeteer. I have tried using page.$eval and page.$$eval . I've also tried this, https://www.javaer101.com/en/article/17934751.html and, Puppeteer page.evaluate querySelectorAll return empty objects and, https://github.com/puppeteer/puppeteer/issues/489 . Each time, I get either an undefined object or and empty array. My current code is:

const botResponses = await page.evaluate((sel) => {
        let elements = Array.from(document.querySelectorAll(sel));
        let responses = elements.map(element => {
            return element.innerText;
        })
        return responses;
    }, ".pb-chat-bubble pb-chat-bubble__bot");

The code returns an empty list. The selector in the code is a valid selector and you can check on the website to confirm. Any help is appreciated!

Answer 1

Have you tried using page.$$eval

const botResponses = await page.$$eval(".pb-chat-bubble pb-chat-bubble__bot",el=>el.innerText)

It does the same thing you're doing above with less code