I have an external user who wants to send me a bunch of CSV files via SFTP that I ultimately want to get into a BigQuery table. How can I set up an FTP? What is the best way to do this? Is it having them upload to Google Cloud Storage bucket? Or to a VM instance? Thank you!
Create a Compute Engine Instance
sftp
Create a firewall rule to accept SFTP connections to your Compute Engine instance
sftp
0.0.0.0/0
or a different range if you know where your Client isCreate a second firewall rule with egress and the same configurations
Install an SFTP server on the compute engine Instance
Additionally, if you want to have the data directly stored in Cloud Storage to avoid issues with the disk space on the Compute Engine with gcsfuse you can mount a GCS bucket on the folder where the SFTP server is doing the upload.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.