如何使用CURL在Apache Nifi中将.csv文件从本地计算机（Getfile）发送到Hive（Puthiveql）？

Question

我想使用CURL将.csv文件或mysql表从本地计算机（GetFile）发送到Apache Nifi中的Hive（PutHiveql），请告诉我是否有任何命令使用Curl。

Answer 1

The question doesn't make sense as formed. If you want to ingest the content of a CSV file into Apache NiFi, route and transform it, and eventually write it to a Hive table, your flow would be as follows:

GetFile -> ConvertRecord (CSVReader to AvroRecordSetWriter) -> [Optional processors] -> PutHiveStreaming

PutHiveStreaming expects the incoming flowfile content to be in Avro format, so the ConvertRecord processor will translate the ingested data into the correct syntax.

I am unsure of how cURL fits into this question at all. NiFi does provide the InvokeHTTP processor to allow arbitrary outgoing HTTP requests, as well as the ExecuteStreamCommand processor to invoke arbitrary command-line activity, including cURL . I don't know why you would need to invoke either in this flow. If you are asking how you could trigger the entire flow via an external cURL command, NiFi provides both ListenHTTP and HandleHTTPRequest processors which start local web servers and listen for incoming HTTP requests. You can connect these processors to a pair of Wait / Notify processors to control the flow of the ingested file data, as GetFile is a source processor, and does not allow incoming flowfiles to trigger it.