aggs过滤器无法在弹性Searach中工作

Question

I am working On Elastic Search For My Current Project.. Need to Remove Duplicate Records My O/p Is as follows:

array (

[1] => Array
    (
        [_index] => vendors
        [_type] => practiceareas
        [_id] => 582
        [_score] => 
        [_source] => Array
            (
                [practice_area_id] => 364
                [id] => 582
                [practice_area_name] => Joint Pains
                [industry_id] => 9
                [category_id] => 12
            )

    )

[2] => Array
    (
        [_index] => vendors
        [_type] => practiceareas
        [_id] => 1315
        [_score] => 
        [_source] => Array
            (
                [practice_area_id] => 237
                [id] => 1315
                [practice_area_name] => Anemia
                [industry_id] => 9
                [category_id] => 15
            )
    )

[3] => Array
    (
        [_index] => vendors
        [_type] => practiceareas
        [_id] => 2087
        [_score] => 
        [_source] => Array
            (
                [practice_area_id] => 364
                [id] => 2087
                [practice_area_name] => Joint Pains
                [industry_id] => 2
                [category_id] => 12
            )
    )

[4] => Array
    (
        [_index] => vendors
        [_type] => practiceareas
        [_id] => 2820
        [_score] => 
        [_source] => Array
            (
                [practice_area_id] => 237
                [id] => 2820
                [practice_area_name] => Anemia
                [industry_id] => 2
                [category_id] => 15
            )
    )

[5] => Array
    (
        [_index] => vendors
        [_type] => practiceareas
        [_id] => 5312
        [_score] => 
        [_source] => Array
            (
                [practice_area_id] => 364
                [id] => 5312
                [practice_area_name] => Joint Pains
                [industry_id] => 2
                [category_id] => 28
            )
    )

)

I need to eliminate replicate values by using practice_area_id / practice_area_name

I already tired as per references.. and my code is as follows:

$query = array(
            "from" => $from,
            "size" => $size,
            "sort" => array(array($fieldname => 'desc')),
            "query" => array(
                "filtered" => array(
                    "query" => array("match_all" => array())
                )
            ),
            "aggs" => array(
                "distinct" => array(
                    "terms" => array(
                        "field" => "practice_area_name",
                    )
                )
            )
        );

But it is not working.. please help me with a solution. Thanks in Advance.

Answer 1

you want to remove replicate documents or you just want to check total distinct documents by practice_area_name or practice_area_id ?

For the second question the sense query look like this

POST vendors/practiceareas/_search
{
    "size": 0, 
    "query": {
        "match_all": {}
    },
    "aggs":{
        "distinct-values":{
            "terms":{
                "field":"practice_area_id",
                "min_doc_count":2
            }
        }
    }
}

output look like this

"aggregations": {
      "distinct-values": {
         "doc_count_error_upper_bound": 0,
         "sum_other_doc_count": 0,
         "buckets": [
            {
               "key": 364,
               "doc_count": 3
            },
            {
               "key": 237,
               "doc_count": 2
            }
         ]
      }
}