Google Cloud - 如何从远程PubSub获取数据作为Apache Beam Pipeline在本地执行的输入？
[英]Google Cloud - How to get data from remote PubSub as input for Apache Beam Pipeline executing locally?
问题描述
I've configured a local (java) environment for executing Apache Beam Pipeline following the official doc . 
我已经在官方文档之后配置了一个本地（java）环境来执行Apache Beam Pipeline。
The sample project (WordCount) works perfectly, but now I'd like to change it and get input data from PubSub topic and put output to BigQuery. 示例项目（WordCount）工作正常，但现在我想更改它并从PubSub主题获取输入数据并将输出放到BigQuery。
I've already created my PubSub topic and my BigQuery dataset, but my question is: how can I configure REMOTE input (pubsub topic) and output (BigQuery) for a locally running Pipeline (for debug purpose)? 我已经创建了我的PubSub主题和我的BigQuery数据集，但我的问题是：如何为本地运行的管道配置REMOTE输入（pubsub主题）和输出（BigQuery）（用于调试目的）？
1 个解决方案
解决方案1
0 已采纳 2019-04-30 13:09:05
See classes PubsubIO / PubsubClient (or com.google.cloud.pubsub.v1 ). 请参阅PubsubIO / PubsubClient （或com.google.cloud.pubsub.v1 ）类。
For remote access you'd most likely need to register an external IP. 对于远程访问，您很可能需要注册外部IP。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.