MergeContent NiFi, parquet/json input
Question
I am trying to use the NiFi MergeContent to merge multiple parquet files together. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.MergeContent/index.html The parquet files I have obtained via the ConvertRecord operator.
Please let me know if you have an example on how to solve this.
1 answers
solution1
0 ACCPTED 2021-01-05 14:14:17
If you are working with Records, as you have used ConvertRecord, consider using MergeRecord instead of MergeContent.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
MergeContent not synchronized NIFI
MergeContent with nifi - inconsistent length
unable to limit size in MergeContent in nifi
Nifi- MergeContent processor- Mergestrategy
Apache Nifi MergeContent output data inconsistent?
NiFi How to MergeContent into a one row csv
Filter JSON via SplitJson and MergeContent
Apache NiFi: How to set space (new line) in MergeContent demarcator?
Apache NIFi MergeContent processor - set demarcator as new line
Nifi: Merging all of necessary flowfile in one shot with MergeContent Processor
Related Tags