如何使用 python 从 S3 获取最新的文件夹路径

Question

I have multiple s3 file paths which contain the folder name as date. I want to extract the latest path from S3 using python and boto3 based on the date.

For Example- Below are the few paths I have under my root folder(s3:///all/stage/servicenow/service-mgmt/sm_task/raw/) Sample Paths -

1. s3://my-bucket/all/stage/pqr/xyz/abc/raw/2020/12/11/10/20/file.parquet
2. s3://my-bucket/all/stage/pqr/xyz/abc/raw/2020/12/11/11/12/file.parquet
3. s3://my-bucket/all/stage/pqr/xyz/abc/raw/2020/12/11/12/01/file.parquet
4. s3://my-bucket/all/stage/pqr/xyz/abc/raw/2020/12/12/11/10/file.parquet

all the above paths are in s3:///all/stage/pqr/xyz/abc/raw/YYYY/MM/DD/HH/mm/file.parquet format

So I need the latest timestamp path under root path (s3:///all/stage/pqr/xyz/abc/raw/) which is s3:///all/stage/pqr/xyz/abc/raw/2020/12/12/11/10/file.parquet.

How can i achieve this using python and Boto3.

Any help will be appreciated as I am new in python

Please comment if the question is not clear

Answer 1

from os import path

is one way to check the file using function

os.path.splitext(root,date)

and just use your own algorithm to check weather or not your file time is the newest