GCP 数据流发布/订阅到发布/订阅

Question

I'm using gcp pub/sub. If there was exception while accepting new message, I put it to dead letter queue. I want to have an opportunity to reprocess message after reviewing. I tried to use Dataflow, but it just sends messages as soon as it came to dead letter queue. Any advices how can I solve it?

Answer 1

For temporary solution, maybe export data from dead letter topic to BigQuery using dataflow. Once you review the data, use any component to process and re-export data to pubsub from BigQuery. This way you can control when to export data. I know this is not ideal. But will help for short term.