Java 8中的Streams：在集群上使用parallelstream（）的简单解决方案？

Question

parallelstream() provides seamless parallelization of operations on the stream across the cores of a single machine.

How can I extend this logic so that parallelstream() distributes these operations to all the machines of a cluster?

Ideally:
- I create a cluster of machines, using framework ??
- launching a myCollection.parallelstream().filter(something).collect() distributes the job to all cores of all machines of the cluster and returns the result to the machine piloting the cluster.

Answer 1

Spark seems to do what you want ie distribute work over nodes. The dsl looks similar to java 8 streams. You can also have a look to akka streams. With akka streams doesn't allow you to do what you want out of the box but it offers you a toolbox to help you with a nice dsl.