将数据从aws aurora mysql连续移动到aws s3

Question

I am trying to setup data lake and move all the data to s3. I have to move aurora mysql data to s3 (most probably in parquet format). I tried initial POC using Data Migration Service with that we can move all data at once. Problem with this was every time I run it will copy whole data. I wanted something like near real time reflection of db changes in s3.

Thanks in advance.

Answer 1

如果启用二进制日志，您应该能够执行更改数据捕获并复制正在进行的更改，如本博客文章中所述