In Kettle, how to acquire table output step's db connection when this step is called? Instead of get all db connection at first

Question

Problem : a simple ktr (a table input step with a hop to a table output step). When start running, kettle get both steps' db connection. But the input step ran for 20 mins (execute sql). After 20 mins, input step started to get data, and passed to Output step, whose db connection had expired.

Idea If the output step can get db connection (Or reconnect) until input step start passing data to it? Instead of get all db connections at first.

Answer 1

You have a step to wait for another step to end, but in this case I don't think that should be the solution, I would try to solve the problem of the Input step spending so much time to retrieve data. If you can't avoid delays with the input data, you could use two transformations instead of only one, and the Table input step writes to a file so the second transformation when you read the file to copy to the other table doesn't time out.