从 S3 文件夹下载文件并为其创建文件夹的 Shell 脚本

Question

I wrote a shell script that uses awscli to get files from a few folders in s3. The issues I am having is that when I run the script, it create the folders, but the files are just downloaded in one. the folders that are created are named the same as in S3. How can I modify this script so that the folders are created, but the files are downloaded into their corresponding folder.

#!/bin/bash -e


DIRNAME='s3download'
SLASH='/'
SEVENFOLDERS=( "folder1" "folder2" "folder3" "folder4" "folder5" "folder6" "folder7" )
SEVENFOLDERPATH=("s3://blah/folder1/" 
"s3://blah/folder2/" "s3://blah/folder3/" "s3://blah/folder4/" "s3://blah/folder5/" "s3://blah/folder6/" "s3://blah/folder7/" )

mkdir $DIRNAME
for i in "${SEVENFOLDERS[@]}"
do
:
SUBDIR=$DIRNAME$SLASH$i
mkdir -p $SUBDIR
done

for k in "${SEVENFOLDERPATH[@]}"
do
:
SUBDIR=$DIRNAME$SLASH$k
aws s3 cp --recursive $k $SUBDIR
done
echo $i "Status: 200 OK"
fi

Answer 1

aws s3 sync将下载与 S3 结构相同的文件。

Answer 2

以下命令替换日期节点中的值。

sed -i -e '/<System>/,/<\/System>/ s|<Date>[0-9a-z:/ .]\{1,\}</Date>|<Date>'"$newDate"'</Date>|g' sample.xml