简体   繁体   中英

How to crawl a s3 bucket for new files

如何抓取s3存储桶以确保是否有任何新文件或对象添加或删除了?

Now you can get a message when there is a change. This was just announced (long overdue):
http://aws.amazon.com/blogs/aws/s3-event-notification/

It is very simple to implement - time to throw out all the ugly cron jobs and list-loops.

By usin Java AWS SDK, able to connect to S3 bucket from Java and able to crawl the bucket.

Crawling is nothing but taking the objects in a list and comparing and identifying the new object.

Example can be found in http://aws.amazon.com/sdk-for-java/

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM