简体   繁体   English

同步两个AWS Glue数据目录

[英]Syncing two AWS Glue Data Catalog

I have a use-case where I want to sync two AWS Glue Data Catalog residing on different accounts. 我有一个用例,我想同步两个驻留在不同账户上的AWS Glue数据目录。

Does Glue emit notifications which can be published when a new database/table/partition is created/deleted? 当创建/删除新的数据库/表/分区时,Glue是否发出可以发布的通知? Or some other way of knowing what is happening in other Glue Data Catalog? 还是通过其他方式知道其他Glue数据目录中正在发生的事情?

One way is to listen Cloudwatch notifications of that Glue account but according to Doc Cloudwatch notifications are not reliable: 一种方法是侦听该Glue帐户的Cloudwatch通知,但是根据Doc Cloudwatch的通知,这是不可靠的:

https://docs.aws.amazon.com/glue/latest/dg/automating-awsglue-with-cloudwatch-events.html https://docs.aws.amazon.com/glue/latest/dg/automating-awsglue-with-cloudwatch-events.html

AWS provides an open source script(s) for that purpose. AWS为此提供了一个开源脚本。 See here 这里

Not sure how reliable and fast it is, but worth trying. 不确定它的可靠性和快速性,但是值得尝试。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM