How to archive files after snowpipe process

Question

After loading files via snowpipe in s3 , how can we send it to archive location. How to set dependency between snowpipe and file archival process. ?

Answer 1

No tool that Snowflake makes available will allow you to do this automatically. You will need to use another method to check to see if the files have been loaded first, then move the files in S3 to another location. You could also set up a lifecycle policy in S3 to handle the archiving?

I don't really like the method of moving the files in S3 after they've been loaded, I think you should put them into their final location in S3 first and have Snowpipe load them from there. That way you don't have to move them again after they have been loaded.