如何为Google数据流实例分配IP范围？

Question

I need to move data from google bigquery to elasticsearch instances, For that I have created python dataflow job to copy bigquery table to elasticsearch. But problem is recently they have added IP based restriction on elastic search instances so that it will allow only for specific IP ranges only.

So How can I identify or assign IP ranges of my dataflow workers when I using "DataflowRunner" option?

Answer 1

In the pipeline options you can set the network and the subnetwork you want to use. Each VPC network contains subnets, each with a defined IP range . By defining the subnet to the ip range needed and setting that subnet in the pipeline options you can assign a ip range to your workers.