AWS S3 API - 按元数据搜索

Question

I use AWS s3 for storing few thousand files per hour and it works like a charm. I'm curious to see if I can filter them based on time or date or any meta data I have with these objects. I'm able to run a node process to get the objects list and play around for date and time but not meta data. Is there any other way do it or a better option ?.

Answer 1

No, you cannot filter on metadata with the S3 API.

To do what you're asking, you would need to List Objects ( GET Bucket ) on the bucket to get all the keys, then individually ask for metadata for each key ( HEAD Object ). Then in your own code, you can filter out objects that don't match.

Obviously, this would be very slow to run live if you have more than a few thousand objects. You'll want to either filter down to a manageable number based on prefix or keep an index yourself (elastic search, maybe?). It's common to encode some metadata in the object keys so that you can filter by prefix.