等待动作完成，然后再在操纵up中执行

Question

I have a puppeteer script that inputs some text into a field, submits the query, and processes the results.

Currently, the script only processes 1 search term at a time, but I need it to be able to process an array of items consecutively.

I figured I would just put the code in a loop (see code below), however, it just types in all the items from the array at once into the field and doesn't execute the code block for each search term:

  for (const search of searchTerms) {
    await Promise.all([
      page.type('input[name="q"]', 'in:spam ' + search + String.fromCharCode(13)),
      page.waitForNavigation({
          waitUntil: 'networkidle2'
        })
    ]);

    const count = await page.evaluate((sel) => {
      return document.querySelectorAll(sel)[1].querySelectorAll('tr').length;
    }, 'table[id^=":"]');

    if (count > 0) {
      const more = await page.$x('//span[contains(@class, "asa") and contains(@class, "bjy")]');
      await more[1].click();

      await page.waitFor(1250);
      const markRead = await page.$x('//div[text()="Mark all as read"]');
      await markRead[0].click();

      const selectAll = await page.$x('//span[@role="checkbox"]');
      await selectAll[1].click();

      const move = await page.$x('//div[@act="8"]');
      await move[0].click();

      await page.waitFor(5000);
    }
  }

I tried using a recursion function from Nodejs Synchronous For each loop

I also tried using a function generator with yields, as well as promises and even tried the eachSeries function from the async package from this post Nodejs Puppeteer Wait to finish all code from loop

Nothing I tried was successful. Any help would be appreciated, thanks!

Answer 1

There is no way to visit two websites at same time with same tab. You can try it on your browser to make sure.

Jokes aside, if you want to search multiple items, you have to create a page or tab for that.

for (const search of searchTerms) {
  const newTab = await browser.newPage()
  // other modified code here
}

... wait that will still search one by one. But if you use a map with concurrency limit, it will work well.

We can use p-all for this.

const pAll = require('p-all');
const actions = []
for (const search of searchTerms) {
  actions.push(async()=>{
    const newTab = await browser.newPage()
    // other modified code here
  })
}
pAll(actions, {concurrency: 2}) // <-- set how many to search at once

So we are looping thru each term, and adding a new promise on the action list. Adding functions won't take much time. And then we can run the promise chain.

You will still need to modify the code above to have what you desire. Peace!