使用 python 或 node.js 将平面文件从 SFTP 上传到 S3

Question

I am getting some flat files every 15 minutes in SFTP server. I want to know, how can i send these files to s3 bucket automatically using python or node.js program? And if some python program runs, where should it run? Should there be any kind of job, which runs this program?

Answer 1

The simplest method would be to schedule a script to run on a regular basis on the server (using cron for Linux or a Scheduled Task for Windows).

The script can use the AWS Command-Line Interface (CLI) , which has a aws s3 cp command that can transfer files to Amazon S3.

If you wish to use Python or Node instead, there are AWS SDKs available for those languages (and many more) that make it easy to transfer files to Amazon S3.

The server sending the files will also need AWS credentials to authorize the data transfer.