简体   繁体   English

如何将数据从 GCS 传输到 Colab GCE VM?

[英]How to transfer data from GCS to Colab GCE VM?

I just launched a Colab virtual machine on the google cloud platform, following this little guide: https://research.google.com/colaboratory/marketplace.html我刚刚在谷歌云平台上启动了一个 Colab 虚拟机,遵循这个小指南: https://research.google.com/colaboratory/marketplace.html

I can connect to the VM with Colab or ssh into the machine and use the shell. Everything seems to be working fine.我可以使用 Colab 或 ssh 连接到虚拟机,然后使用 shell。一切似乎都运行良好。

Now I want to transfer data from google cloud storage to the VM and have it accessible from the Colab connection.现在我想将数据从谷歌云存储传输到虚拟机,并通过 Colab 连接访问它。 This is easiest from the shell, but I can't figure out where the Colab notebook lives on the disk... Poking around the filesystem from the notebook and from the shell, I can't find where they meet.从 shell 开始,这是最简单的,但我无法弄清楚 Colab 笔记本在磁盘上的位置......从笔记本和 shell 中查找文件系统,我找不到它们在哪里相遇。

Where on the VM should I transfer data to make it easily accessible from the notebook?我应该在 VM 上的哪个位置传输数据以便从笔记本轻松访问?

Replicated the Colab GCE VM on my end by following the steps from this documentation starting a GCE VM on Colab via GCP Marketplace .按照本文档中的步骤通过 GCP Marketplace 在 Colab 上启动GCE VM,在我这边复制了 Colab GCE VM。 After the creation of Colab GCE VM found that Colab Notebooks was not inside the filesystem/disk of VM, but it's created on Google Drive.创建 Colab GCE VM 后发现 Colab Notebooks 不在 VM 的文件系统/磁盘中,而是在 Google Drive 上创建的。 From this article How to Deal With Files in Google Colab it is stated that "Since a Colab Notebook is hosted on Google's Cloud servers, there's no direct access to files on your local drive or any other environment by default."这篇文章如何处理 Google Colab 中的文件指出“由于 Colab Notebook 托管在 Google 的云服务器上,因此默认情况下无法直接访问本地驱动器或任何其他环境中的文件。”

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 如何将新添加的 avro 数据从 GCS 自动传输到 BigQuery - How to automatically transfer newly added avro data from GCS to BigQuery 如何暂停/恢复 GCE VM - How to suspend/resume GCE VM 将文件从 GCS 存储桶传输到 Webdav 服务器 - Transfer files from GCS bucket to Webdav server 如何将文件从 GCE VM 上的 R Studio 服务器保存到 Google Cloud Bucket? 可能的设置问题 - How to save files from R Studio-server on GCE VM to a Google Cloud Bucket? Possible settings issue 如何将数据从 GCS 导入到 Vertica 原生表 - How to import data from GCS to Vertica native table 如何在 docker 容器完成后自动关闭 GCE VM? - How to automatically shutdown a GCE VM after the docker container finishes? 如何在 Airflow 中使用 Airflow AWS 连接凭证使用 BashOprator 将文件从 AWS s3 存储桶传输到 GCS - How to use Airflow AWS connection credentials in Airflow using BashOprator to transfer files from AWS s3 bucket to GCS GCP中VM e2-small实例的数据传输限制是多少 - how much is the data transfer limit for a VM e2-small instance in GCP 从 GCS 加载_Csv_data 到 Bigquery - Load_Csv_data from GCS to Bigquery 将数据从 GCS 中的文件加载到 GCP firestore - Loading data from a file in GCS to GCP firestore
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM