GCP Dataflow- 从 Compute Engine VM 读取 CSV 文件并写入 BigQuery
[英]GCP Dataflow- read CSV file from Compute Engine VM and write into BigQuery
问题描述
GCP Dataflow- 从 Storage 读取 CSV 文件并写入 BigQuery
1 个解决方案
解决方案1
0 2020-02-18 19:56:42
Cloud Dataflow can't read files from the disk of VM. 
Cloud Dataflow 无法从 VM 的磁盘读取文件。 The best way is to upload your file into a Bucket and then to use BuiltIn connector .最好的方法是将您的文件上传到 Bucket 中，然后使用BuiltIn connector 。 In Java, I use FileIO .在 Java 中，我使用FileIO 。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
GCP Dataflow-从存储读取CSV文件并写入BigQuery - GCP Dataflow- read CSV file from Storage and write into BigQuery
如何将 .csv 文件读入 GCP 数据流，然后获取特定列的计数并将其写入 BigQuery？ - How do I read a .csv file into a GCP Dataflow and then get the count for a specific column and write it to BigQuery?
来自数据流作业/计算引擎的 GCP CloudSql 连接限制 - GCP CloudSql Connection limit from Dataflow Job/compute engine
无法从 Compute Engine 虚拟机实例 (GCP) 连接到 Memorystore - Cannot Connect to Memorystore from Compute Engine Vm Instance (GCP)
谷歌云数据流（Python）：function 读取和写入 a.csv 文件？ - Google Cloud Dataflow (Python): function to read from and write to a .csv file?
在 GCP Compute Engine 虚拟机上远程连接到 MySQL - Remote connection to MySQL on GCP Compute Engine VM
Kubernetes pod 与 GCP Compute Engine 虚拟机通信 - Kubernetes pod to GCP Compute Engine VM communication
GCP Dataflow-如何使用Dataflow从Google BigQuery读取数据并将其加载到Google Spanner - GCP Dataflow - How to read the data from Google BigQuery and load into Google Spanner using Dataflow
如何从数据流中的谷歌存储桶中读取 csv 文件，组合，对数据流中的数据帧进行一些转换，然后将其转储到 bigquery 中？ - How to read from csv file from google bucket in dataflow, combine, do some transformation on dataframes in dataflow, then dump it into bigquery?
GCP Firebase 连接到计算引擎虚拟机 - GCP Firebase connection to compute engine VM
相关标签