在 teradata 的 parquet 文件中导出数据

Question

I cannot figure out a solution for exporting data from the Teradata database in a parquet format. I am using tdload and tbuild method which required tpt script to be generated.

What should be the solution to export file in parquet files from the Teradata database?

tdload cmd -

tdload --SourceTdpid 192.168.xx.xx --SourceUserName dbc --SourceUserPassword dbc --SourceTable AdventureDW.FactProductInventory --TargetTextDelimiter "|" --FileWriterFileSizeMax 30G --TargetFilename F:\Data\data.parquet My_Unload_Job

What changes should I do the command to get output in parquet format?

Answer 1

I was able to convert the data from csv to parquet format via dask framework. Here post the extraction, using pyarrow engine I was able to convert the large csv datasets into inbuilt parquet function via dask framework