[英]Python multiprocessing doesn't work as predicted
我在网上找到了这个代码,预测结果应该显示当前正在处理的进程名称,但是当我运行代码时它只给出结果而不是名称。 我正在运行Windows 7 Python 2.7.3。
码:
import multiprocessing
def do_calculation(data):
return data * 2
def start_process():
print 'Starting', multiprocessing.current_process().name
if __name__ == '__main__':
inputs = list(range(10))
print 'Input :', inputs
builtin_outputs = map(do_calculation, inputs)
print 'Built-in:', builtin_outputs
pool_size = multiprocessing.cpu_count() * 2
pool = multiprocessing.Pool(processes=pool_size,
initializer=start_process,
)
pool_outputs = pool.map(do_calculation, inputs)
pool.close() # no more tasks
pool.join() # wrap up current tasks
print 'Pool :', pool_outputs
预期结果:
$ python multiprocessing_pool.py
Input : [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]
Built-in: [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
Starting PoolWorker-11
Starting PoolWorker-12
Starting PoolWorker-13
Starting PoolWorker-14
Starting PoolWorker-15
Starting PoolWorker-16
Starting PoolWorker-1
Starting PoolWorker-2
Starting PoolWorker-3
Starting PoolWorker-4
Starting PoolWorker-5
Starting PoolWorker-8
Starting PoolWorker-9
Starting PoolWorker-6
Starting PoolWorker-10
Starting PoolWorker-7
Pool : [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
如果我在控制台中运行以下代码而不是IDLE (我在使用PyCharm之后会继续使用):
from multiprocessing import *
def main():
data = list(range(10))
print('Data:', data)
result = list(map(calculate, data))
print('Map: ', result)
pool = Pool(cpu_count() * 2, initialize)
result = pool.map(calculate, data, 1)
pool.close()
pool.join()
print('Pool:', result)
def calculate(number):
return number * 2
def initialize():
print('Starting', current_process().name)
if __name__ == '__main__':
main()
以下内容将按预期打印到控制台屏幕上(使用PoolWorkers的随机顺序):
C:\Users\schappell\Desktop>stack_overflow.py
Data: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]
Map: [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
Starting PoolWorker-1
Starting PoolWorker-13
Starting PoolWorker-2
Starting PoolWorker-3
Starting PoolWorker-8
Starting PoolWorker-5
Starting PoolWorker-14
Starting PoolWorker-16
Starting PoolWorker-15
Starting PoolWorker-12
Starting PoolWorker-6
Starting PoolWorker-9
Starting PoolWorker-4
Starting PoolWorker-10
Starting PoolWorker-7
Starting PoolWorker-11
Pool: [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
C:\Users\schappell\Desktop>
作为旁注,请尝试运行以下代码(使用和不使用time.sleep
注释掉):
from multiprocessing import *
import time
def main():
data = list(range(10))
print('Data:', data)
print('Map: ', list(map(calculate, data)))
pool = Pool(cpu_count() * 2, initialize)
## time.sleep(1)
print('Pool:', pool.map(calculate, data, 1))
pool.close()
pool.join()
def calculate(number):
return number * 2
def initialize():
print('Starting', current_process().name)
if __name__ == '__main__':
main()
没有睡眠,你可能会得到这样的东西(显示你的游泳池尚未完全创建):
C:\Users\schappell\Desktop>stack_overflow.py
Data: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]
Map: [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
Starting PoolWorker-2
Pool: [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
Starting PoolWorker-1
Starting PoolWorker-10
Starting PoolWorker-9
Starting PoolWorker-6
Starting PoolWorker-14
Starting PoolWorker-13
Starting PoolWorker-5
Starting PoolWorker-4
Starting PoolWorker-3
Starting PoolWorker-8
Starting PoolWorker-11
Starting PoolWorker-12
Starting PoolWorker-16
Starting PoolWorker-7
Starting PoolWorker-15
C:\Users\schappell\Desktop>
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.