使用快速中间件的正确方法？

Question

I have a question regarding express (connect) middleware. What i'm trying to do is downloading DoubleClick Bid Manager Reports, parse and process them into my own MongoDB database.

My route looks as following:

    app.route('/v1/spends/')
    .get(dbmPolicy.isAllowed, buckets.read, buckets.check, reports.create, buckets.process, reports.update);

Where buckets.read reads files from Google Cloud Storage, buckets.check checks if report has already been processed into MongoDB, reports.create creates the report that holds the metadata of the csv. buckets.process processes the data that resides inside of the csv and reports.update updates the previously created report if all went succesfull.

As I find it very difficult to test the above process, I'm starting to doubt whether this is the correct way to implement the chain of processes. If this is the correct way, how do I test each middleware function individually on it's behaviour?

Regards,

Answer 1

You may want to look into the Async package and especially the waterfall method. That way you can run something like:

app.get('/v1/spends', function(req, res) {
    async.waterfall([
        dbmPolicy.isAllowed,
        buckets.read,
        buckets.check,
        reports.create,
        buckets.process,
        reports.update    
    ], function (err, result) {
       if (err) res.status(500).send(err); 
       res.status(200).send(result);
    });
});