如何在Elastic搜索中创建和添加自定义分析器？

Question

i have a batch of "smartphones" products in my ES and I need to query them by using "smart phone" text. So I m looking into the compound word token filter. Specifically , I m planning to use a custom filter like this:

curl -XPUT 'localhost:9200/_all/_settings -d '
{
  "analysis" : {
    "analyzer":{
      "second":{
        "type":"custom",
        "tokenizer":"standard",
        "filter":["myFilter"]
      }
      "filter": {
        "myFilter" :{
             "type" : "dictionary_decompounder"
             "word_list": ["smart", "phone"]
             }
             }             
    }
}
}
'

Is this the correct approach ? Also I d like to ask you how can i create and add the custom analyser to ES? I looked into several links but couldn't figure out how to do it. I guess I m looking for the correct syntax. Thank you

EDIT

I m running 1.4.5 version. and I verified that the custom analyser was added successfully:

{
  "test_index" : {
    "settings" : {
      "index" : {
        "creation_date" : "1453761455612",
        "analysis" : {
          "filter" : {
            "myFilter" : {
              "type" : "dictionary_decompounder",
              "word_list" : [ "smart", "phone" ]
            }
          },
          "analyzer" : {
            "second" : {
              "type" : "custom",
              "filter" : [ "lowercase", "myFilter" ],
              "tokenizer" : "standard"
            }
          }
        },
        "number_of_shards" : "5",
        "number_of_replicas" : "1",
        "version" : {
          "created" : "1040599"
        },
        "uuid" : "xooKEdMBR260dnWYGN_ZQA"
      }
    }
  }
}

Answer 1

Your approach looks good, I would also consider adding lowercase token filter , so that even Smartphone (notice Uppercase 'S') will be split into smart and phone .

Then You could create index with analyzer like this,

curl -XPUT 'localhost:9200/your_index -d '
{
  "settings": {
    "analysis": {
      "analyzer": {
        "second": {
          "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "lowercase",
            "myFilter"
          ]
        }
      },
      "filter": {
        "myFilter": {
          "type": "dictionary_decompounder",
          "word_list": [
            "smart",
            "phone"
          ]
        }
      }
    }
  },
  "mappings": {
    "my_type": {
      "properties": {
        "name": {
          "type": "string",
          "analyzer": "second"
        }
      }
    }
  }
}
'

Here you are creating index named your_index , custom analyzer named second and applied that to name field.

You can check if the analyzer is working as expected with analyze api like this

curl -XGET 'localhost:9200/your_index/_analyze' -d '
{
  "analyzer" : "second",
  "text" : "LG Android smartphone"
}'

Hope this helps!!