What is an efficient way to send large data over the wire?

Question

I have a list of strings List<string> . Actually is a list of file paths. And I need to send it to a webservice. The list can contain huge count of items (1 000 - 10 000).

What would be the most efficient way to accomplish this? considering that the message payload will be quite high.

I am asking for ideas and principles, not code samples.

Thanks much.

Answer 1

For paths - firstly (or rather: lastly) gzip or deflate it. If large numbers of things are going to have common roots, nest that data perhaps?

ie so

/foo/bar/blap/a/b
/foo/bar/blap/c/d

becomes

/foo/bar/blap
 /a/b
 /c/d

Beyond that - the payload is going to far exceed any protocol overheads etc, so use whichever protocols etc make life simple for you.

Answer 2

just using compression. gzip or deflate stream. string compression ratio is very good.

Answer 3

如果您坚持使用某种通信协议，则可以考虑分块。

Answer 4

已经建议的结合放气技术的序列化是高效且可靠的。