[英]Migrating data from RDBMS to ElasticSearch using Apache NIfi
We are trying to migrate data from RDBMS to elastic search using Apache Nifi.我们正在尝试使用 Apache Nifi 将数据从 RDBMS 迁移到弹性搜索。 We have created pipelines in Nifi and are able to transfer data but are facing some issues and wanted to check if someone already got over them.
我们已经在 Nifi 中创建了管道,并且能够传输数据,但面临一些问题,并想检查是否有人已经克服了它们。
Please provide inputs on the below items.请就以下项目提供意见。
1.How to avoid auto-generating _id in elastic search. 1.如何避免弹性搜索中自动生成_id。 We want this to be set from a DB column.
我们希望从数据库列中设置它。 We tried providing the column name in the "Identifier Record Path" attribute in the PutElasticSearchHTTPRecord processor but were getting an error that the attribute name is not valid.
我们尝试在 PutElasticSearchHTTPRecord 处理器的“标识符记录路径”属性中提供列名称,但收到属性名称无效的错误。 Can you please let us know the acceptable format.
你能告诉我们可接受的格式吗?
Thanks in Advance!提前致谢!
It needs to be a RecordPath statement like /myidfield
它需要是像
/myidfield
这样的 RecordPath 语句
You need to manually create nested fields in Elasticsearch.您需要在 Elasticsearch 中手动创建嵌套字段。 This is not a NiFi thing, but how Elasticsearch works.
这不是 NiFi 的事情,而是 Elasticsearch 的工作原理。 If you were to post a document with
cURL
, you would run into the same issues.如果您要使用
cURL
发布文档,您会遇到同样的问题。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.