NodeJS 和 MongoDB 查询速度慢

Question

so running into an issue where I am using NodeJS with Express for API calls. I am fetching all documents in a collection using

    export async function main(req, res) {
    try {
        const tokens = await tokenModel.find({}).lean();
        res.json(tokens);
    } catch {(err) => {
        res.status(500).json({ message: err.message })
        console.log('err', err.message)
        }
    }
  console.log('Get Data')
}

Now this request works great and returns me the data I need. The problem is I have over 10K documents, and on a PC takes about 10 seconds to return that data, and on a mobile phone it takes over 45 seconds. I know network on phone matters, but is there any way I can increase this? Nothing I have tried works. I keep finding that lean is the option to use, and I am already using it with no success or improvements.

Answer 1

Well, it's slow because you are returning all 10k results.

Do you actually need all 10k results? If not, you should consider filtering only results that you actually need.

If not, I suggest implementing pagination, where you would return results in batches (50 per page for example).

In addition, if you are using only some of the fields from the documents, you should tell MongoDB to return only these fields, and not all of them. That would also increase the performance since less data will be transferred through the network.