简体   繁体   English

如何分组mongodb - mapReduce输出?

[英]How to Group mongodb - mapReduce output?

i have a query regarding the mapReduce framework in mongodb, so i have a result of key value pair from mapReduce function , now i want to run the query on this output of mapReduce. 我有关于mongodb中的mapReduce框架的查询,所以我有mapReduce函数的键值对的结果,现在我想在mapReduce的这个输出上运行查询。

So i am using mapReduce to find out the stats of user like this 所以我使用mapReduce来查找这样的用户统计信息

db.order.mapReduce(function() { emit (this.customer,{count:1,orderDate:this.orderDate.interval_start}) },
function(key,values){ 
    var sum =0 ; var lastOrderDate;  
    values.forEach(function(value) {
     if(value['orderDate']){ 
        lastOrderDate=value['orderDate'];
    }  
    sum+=value['count'];
}); 
    return {count:sum,lastOrderDate:lastOrderDate}; 
},
{ query:{status:"DELIVERED"},out:"order_total"}).find()

which give me output like this 这给了我这样的输出

{ "_id" : ObjectId("5443765ae4b05294c8944d5b"), "value" : { "count" : 1, "orderDate" : ISODate("2014-10-18T18:30:00Z") } }
{ "_id" : ObjectId("54561911e4b07a0a501276af"), "value" : { "count" : 2, "lastOrderDate" : ISODate("2015-03-14T18:30:00Z") } }
{ "_id" : ObjectId("54561b9ce4b07a0a501276b1"), "value" : { "count" : 1, "orderDate" : ISODate("2014-11-01T18:30:00Z") } }
{ "_id" : ObjectId("5458712ee4b07a0a501276c2"), "value" : { "count" : 2, "lastOrderDate" : ISODate("2014-11-03T18:30:00Z") } }
{ "_id" : ObjectId("545f64e7e4b07a0a501276db"), "value" : { "count" : 15, "lastOrderDate" : ISODate("2015-06-04T18:30:00Z") } }
{ "_id" : ObjectId("54690771e4b0070527c657ed"), "value" : { "count" : 6, "lastOrderDate" : ISODate("2015-06-03T18:30:00Z") } }
{ "_id" : ObjectId("54696c64e4b07f3c07010b4a"), "value" : { "count" : 1, "orderDate" : ISODate("2014-11-18T18:30:00Z") } }
{ "_id" : ObjectId("546980d1e4b07f3c07010b4d"), "value" : { "count" : 4, "lastOrderDate" : ISODate("2015-03-24T18:30:00Z") } }
{ "_id" : ObjectId("54699ac4e4b07f3c07010b51"), "value" : { "count" : 30, "lastOrderDate" : ISODate("2015-05-23T18:30:00Z") } }
{ "_id" : ObjectId("54699d0be4b07f3c07010b55"), "value" : { "count" : 1, "orderDate" : ISODate("2014-11-16T18:30:00Z") } }
{ "_id" : ObjectId("5469a1dce4b07f3c07010b59"), "value" : { "count" : 2, "lastOrderDate" : ISODate("2015-04-29T18:30:00Z") } }
{ "_id" : ObjectId("5469a96ce4b07f3c07010b5e"), "value" : { "count" : 1, "orderDate" : ISODate("2014-11-16T18:30:00Z") } }
{ "_id" : ObjectId("5469c1ece4b07f3c07010b64"), "value" : { "count" : 9, "lastOrderDate" : ISODate("2015-04-15T18:30:00Z") } }
{ "_id" : ObjectId("5469f422e4b0ce7d5ee021ad"), "value" : { "count" : 5, "lastOrderDate" : ISODate("2015-06-01T18:30:00Z") } }
......

Now i want to run query and group the users on the basis of count in different categories like for user with count less than 5 in one group , 5-10 in another, etc 现在我想运行查询并根据不同类别的计数对用户进行分组,例如一组中小于5,另一组中小于5的用户等

and want output something like this 并希望输出这样的东西

{userLessThan5: 9 }
{user5to10: 2 }
{user10to15: 1 }
{user15to20: 0 }
  ....

Try this, 尝试这个,

db.order.mapReduce(function() { emit (this.customer,{count:1,orderDate:this.orderDate.interval_start}) },
function(key,values){ 
var category; // add this new field
var sum =0 ; var lastOrderDate;  
values.forEach(function(value) {
 if(value['orderDate']){ 
    lastOrderDate=value['orderDate'];
}  
sum+=value['count'];
}); 
// at this point you are already aware in which category your records lies , just add a new field to mark it
 if(sum < 5){ category: userLessThan5};
 if(sum >= 5 && sum <=10){ category: user5to10};
 if(sum <= 10 && sum >= 15){ category: user10to15};
 if(sum <= 15 && sum >=20){ category: user15to20};
  ....
return {count:sum,lastOrderDate:lastOrderDate,category:category}; 
},
{ query:{status:"DELIVERED"},out:"order_total"}).find()
 db.order_total.aggregate([{ $group: { "_id": "$value.category", "users": { $sum: 1 } } }]);

you will get you desired result 你会得到你想要的结果

{userLessThan5: 9 }
{user5to10: 2 }
{user10to15: 1 }
{user15to20: 0 }
 ....

I wrote a query using your data in aggregation as per my knowledge, there may be better way to solve this problem. 根据我的知识,我在聚合中使用您的数据编写了一个查询,可能有更好的方法来解决这个问题。

var a=db.test.aggregate([{$match:{"value.count":{$lt:5}}},
              { $group: { _id:"$value.count",total:{"$sum":1}}},
             {$group:{_id:"less than 5",total:{$sum:"$total"}}}])              

var b=db.test.aggregate([{$match:{"value.count":{$lt:10,$gt:5}}},
            { $group: { _id:"$value.count",total:{"$sum":1}}},
            {$group:{_id:"between 5 and 10",total:{$sum:"$total"}}}])

var c=db.test.aggregate([{$match:{"value.count":{$lt:15,$gt:10}}},
       { $group: { _id:"$value.count",total:{"$sum":1}}},
       {$group:{_id:"between 10 and 15",total:{$sum:"$total"}}}])

insert a, b, c into another collection 将a,b,c插入另一个集合中

You could try to group the output data after mapreduce to every 5 interval count through aggregate like below 你可以通过尝试组映射精简后的输出数据每5间隔计数aggregate如下图所示

db.data.aggregate([
    { "$group": {
        "_id": {
            "$subtract": [
                { "$subtract": [ "$value.count", 0 ] },
                { "$mod": [ 
                    { "$subtract": [ "$value.count", 0 ] },
                    5
                ]}
            ]
        },
        "count": { "$sum": 1 }
    }}
])

Also maybe here is one related question here . 也许这里有一个相关的问题

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM