将新摄取文件的审计报告自动化到 s3

Question

How can we automate of generating an audit report containing file name and timestamp of new ingested file into aws s3 using python or any other methods.

minimizing manual process and automating the process.

Answer 1

You can use S3 event notification to trigger an AWS Lambda function to process the file. Please note that Lambda has a maximum execution time of 15mins. If you need more time to process the file, you could spin up an EC2 instance or an ECS Task if you prefer to use container.