[英]How to execute multiple models in parallel instead of sequentially?
我有各种型号,我依次逐个执行这些模型。 我将有大约200个型号。
下面是我的代码,我逐个执行这些模型
Map<String, List<ServerMetrics>> metricsHolder = new HashMap<String, List<ServerMetrics>>();
for (String alias : serverNames) {
List<ClientsModel> modelMetadata = getModelAttributes();
List<MachineInfo> machineInfo = getMachineInfo();
List<ServerMetrics> metricsList = new ArrayList<ServerMetrics>();
// calling model one by one sequentially
// is there any way to make this multithreaded?
// here modelMetadata size might be 100 or 200
for (ClientsModel modelList : modelMetadata) {
String modelValue = modelList.getModelValue();
String modelId = String.valueOf(modelList.getModelId());
// execute my model here and storing the metrics in the metricsList object
ServerMetrics metrics = TestUtils.executeModelMetrics(machineInfo, modelValue);
metrics.setModelId(modelId);
metricsList.add(metrics);
}
metricsHolder.put(alias, dynMetricsList);
}
问题陈述:-
有没有什么办法可以让模型执行多线程,然后将结果存储到metricsList
对象中?
如果代码中没有数据争用条件(对未正确同步的相同数据进行多线程访问),则可以使用ExecutorService
形式的线程Callable
在线程上运行Callable
实现。 你可以在Callable
完成工作。
在主线程上, ExecutorService
返回一个Future
,然后您可以在生成所有任务后等待。
线程池的大小(此处设置为10
,但您可以更改它)确定并行运行的数量。 您仍然可以执行比线程池大小更多的Callable
。
Map<String, List<ServerMetrics>> metricsHolder = new HashMap<String, List<ServerMetrics>>();
// Size of thread pool set at 10 - can be increased but increasing it
// to more than the number of cores on your computer is probably not
// useful, as it seems like your task is CPU-bound
ExecutorService executorService = Executors.newFixedThreadPool(10);
for (String alias : serverNames) {
List<ClientsModel> modelMetadata = getModelAttributes();
List<MachineInfo> machineInfo = getMachineInfo();
List<Future<ServerMetrics>> metricsFutureList = new ArrayList<Future<ServerMetrics>>();
// calling model one by one sequentially
// is there any way to make this multithreaded?
for (ClientsModel modelList : modelMetadata) {
final String modelValue = modelList.getModelValue();
final String modelId = String.valueOf(modelList.getModelId());
metricsFutureList.add(executorService.submit(new Callable<ServerMetrics>() {
@Override
public ServerMetrics call() throws Exception {
// execute my model here and storing the metrics in the list
ServerMetrics metrics = TestUtils.executeModelMetrics(machineInfo, modelValue);
metrics.setModelId(modelId);
return metrics;
}
}));
}
List<ServerMetrics> metricsList = new ArrayList<ServerMetrics>();
for (Future<ServerMetrics> future : metricsFutureList) {
metricsList.add(future.get());
}
metricsHolder.put(alias, dynMetricsList);
}
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.