How to specify instance type in dataflow jobs?

Question

We are using data flow jobs to delete the data store entries. We are using the below mentioned command.

gcloud dataflow jobs run del-data-8 --gcs-location gs://dataflow-templates/latest/Datastore_to_Datastore_Delete --parameters datastoreReadGqlQuery='select * from `ml-data`' --parameters datastoreReadProjectId=xxx --parameters datastoreDeleteProjectId=xxx

What parameter we should use to specify the instance type for the above data flow job?

Answer 1

You can specify the instance type with the flag --machine-type . For more information on the machine types you can choose, you can refer tothis document .

I hope that helps.

Answer 2

You could use workerMachineType for setting them. Please refer the below doc.

https://cloud.google.com/dataflow/docs/reference/pipeline-options