简体   繁体   中英

How to send a big set of data from one server to another?

There are two LAMP servers, A and B, in different countries. Once a day A has an updated set of data, that is to be processed on B. What would be the best way to set a communication between them?

Estimated size of an update is 20Mb compressed.

Options that comes to my mind are:

  1. curl POST request, uploading compressed data in JSON;
  2. SQL dump of a tmp table, compressed, then rsync'ed to B. B watching specific folder for update. Then importing the table and processing;
  3. Message Queuing with RabbitMQ or Amazon Simple Queue;
  4. ..other option?

Should you have any experience with a similar tasks, please share your thoughts.

选项2,无论是在网络上还是使用ftp,都可以使用cronjobs在计划的时间(可能是在晚上)运行任务。

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM