如何将增量数据从本地 MySql 复制到 Azure MySql 当本地 Z9DF306F03DAEDCCF82ZF5E2 使用 AEDCCF82ZF5E2 参考时的日期字段

Question

I was trying to copy from on-premises mysql to azure mysql using ADF. Some tables have date filled so, that I can use tumbling window feature and populate incremental data. But some of the tables don't have any date filled for reference.

Is their any feature to get incremental data for such tables?

Answer 1

Per my experience,data fields(such as createTime,modifyTime) have to be produced when you design table structure.It's significant for log monitor,troubleshooting and increment.As @Martin said in the comment,you always need to have a field to determine the criteria for increments.

If it is acceptable, you could add data field(just auto completed,no need to change your other strategy) to guaranteed consistency from now on.If the table can't be modified,maybe you need to consider adding other residence for new data at the same time.For example, Azure table storage,which you could control columns.