[英]How to Create external table in snowflake based on S3 partitioned data
I have an s3 URL as s3://Sales//region.我有一个 s3 URL 作为 s3://Sales//region。
I have date buckets inside the region folder as:我在区域文件夹中有日期桶:
refdate=2022-02-26, refdate=2022-02-25 and refdate=2022-02-24参考日期=2022-02-26、参考日期=2022-02-25 和参考日期=2022-02-24
How would I create an external table in snowflake with partition as ref date folder?我如何在雪花中创建一个外部表并将分区作为参考日期文件夹? what have I tried so far:到目前为止我尝试了什么:
Create external table sales (..)
PARTITION BY refdate
with location = @sales_stage/region/
file_format = COMP_ap
aws_sns_topic='arn:aws:sns:us-west38:snowflake-dev-SNS'
auto_refresh = true ;
Thanks,谢谢,
Xi习
create stage s2
url='s3://Sales//region/'
...
;
create external table et1(
date_part date as to_date(split_part(metadata$filename, '-', 3)
|| '/' || split_part(metadata$filename, '-', 4)
|| '/' || split_part(metadata$filename, '-', 5), 'YYYY/MM/DD'),
timestamp bigint as (value:timestamp::bigint),
partition by (date_part)
location=@s2
auto_refresh = true
aws_sns_topic = 'arn:aws:sns:us-west38:snowflake-dev-SNS';
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.