如何在 Glue Spark ETL 作业上倒带作业书签？

Question

I have read here that now Glue provides the ability to rewind job bookmarks for Spark ETL job.

Still, I haven't been able to find any information on how to do that. The sub-options in the "paused" job bookmark option seem to be useful in rewinding a job bookmark, but I can't find how to implement them (I am using Glue console.)

Answer 1

What you need to pass following parameters in "Job parameters" section. With job bookmarks paused.

job-bookmark-from <from-value> is the run ID which represents all the input that was processed until the last successful run before and including the specified run ID.

job-bookmark-to <to-value> is the run ID which represents all the input that was processed until the last successful run before and including the specified run ID. The corresponding input excluding the input identified by the is processed by the job.