Amazon Athena：如何在查询跳过列标题后存储结果？

Question

I ran a simple query using Athena dashboard on data of format csv.The result was a csv with column headers. When storing the results,Athena stores with the column headers in s3.How can i skip storing header column names,as i have to make new table from the results and it is repetitive

Answer 1

From an Eric Hammond post on AWS Forums :

...
  WHERE
    date NOT LIKE '#%'
...

I found this works! The steps I took:

• Run an Athena query, with the output going to Amazon S3
• Created a new table pointing to this output based on How do I use the results of my Amazon Athena query in another query? , changing the path to the correct S3 location
• Ran a query on the new table with the above WHERE <datefield> NOT LIKE '#%'

However, subsequent queries store even more data in that S3 directory, so it confuses any subsequent executions.

Answer 2

Try "skip.header.line.count"="1", This feature has been available on AWS Athena since 2018-01-19, here's a sample:

CREATE EXTERNAL TABLE IF NOT EXISTS tableName (
  `field1` string,
  `field2` string,
  `field3` string 
)
 ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
 WITH SERDEPROPERTIES (
   'separatorChar' = ',',
   'quoteChar' = '\"',
   'escapeChar' = '\\'
   )
LOCATION 's3://fileLocation/'
TBLPROPERTIES ('skip.header.line.count'='1')

You can refer to this question: Aws Athena - Create external table skipping first row