为什么在 GCP 的 java sdk 中编写的数据流作业管道的日志不可见？

Question

I have enabled the logging API by below command:

gcloud services enable logging

I have followed the steps: https://cloud.google.com/dataflow/docs/quickstarts/create-pipeline-java to create the pipeline.

I am using slf4j logger lib for logging the jobs. still, no logs are visible in GCP dataflow console.

Answer 1

Creating a new sink in Logs Router with an inclusion filter of resource.type="dataflow_step" solved the issue as dataflow logs are excluded in the default sink present at the log router under logging.

Answer 2

Are you using a service account? Besides enabling the Logging service, you may not have permission to write the the logs.

If that is the case, please double-check if you are following all the instructions from Security and permissions for pipelines on Google Cloud .