elasticsearch-py : How to put a pipeline

Question

elasticsearch._async.client.logstash.put_pipeline function does not provide any example of pipeline format.

Did someone ever used it?

I would like to use logstash to copy from elasticsearch to a local repository, I know how to do it with a conf file but I don't know how to format pipeline param in put_pipeline function.

I always get BadRequestError(400, 'x_content_parse_exception', '[1:1] [pipeline] failed to parse object')

Answer 1

Tldr;

pipeline parameter does not exist in the documentation of elasticsearch-py for put_pipeline .

Example

from elasticsearch import Elasticsearch

es = Elasticsearch(
    cloud_id=cloud_id,
    basic_auth=basic_auth
)

es.ingest.put_pipeline(
    id="73471565",
    description="a test pipeline for 73471565",
    processors=[{
      "set" : {
        "description" : "My optional processor description",
        "field": "my-keyword-field",
        "value": "foo"
      }
    }]
)