简体   繁体   中英

China to AWS Multi-Master Replication

I am currently supporting a system that sits inside a data center in China, but has terrible performance outside of China due to the firewall. We are in the process of setting up a data center in AWS, and need to replicate the data. Our application is for travelers, so a user could easily access the system once inside China and once outside China within hours. The requirements:

  • Near-realtime (but not realtime) data consistency
  • ability to handle partitions, where the network may be down for minutes at a time
  • ability to handle high latency, eg 300-500ms
  • ability to handle failed requests, where a percentage of requests will hang or be dropped
  • Free or nearly free in cost
  • ability to make relatively flexible queries (eg sorting by different fields, partial keywords search such as the LIKE clause, etc)

We are currently on Cassandra, and it will handle everything but the last item on this list. A lot of our data isn't suited to Cassandra's format, but was built this way before we fully understood Cassandra's data model. So in order to support the last requirement, we have two ideas:

  1. Add MySQL servers at each data center that sync with Cassandra data using some queueing mechanism, and data consumers only do read-only queries to these servers.
  2. Migrate the data to MySQL or PostGres and set up a Multi-Master asynchronous cluster across data centers.

I have two questions:

  1. For those of you with experience setting up multi master replication across low quality WANs, which of these is the better approach? If neither, how did you solve your problem?
  2. Do MySQL, PostGres, MariaDB, or any other free DBs or 3rd party extensions support this scenario well?

我有第三个选择:为DataStax Enterprise及其在Cassandra上的集成Solr搜索付费。

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM