[英]How to control parallel processes with condition
我想控制我的进程,而我没有找到工作 url。
但是我有NameError: name 'status' is not defined
由于线程没有等待声明一个变量
import requests
from multiprocessing import Process
def first_function(i):
global status
status = False
try:
response = requests.get(f'https://ru.hexlet.io/{i}')
if response.status_code == 200:
status = True
except Exception as e:
print(str(e))
def second_function():
for i in [1,2,3,4,5,6,'courses',8,9,10]:
Process(target=first_function, args=(i, )).start()
print(i)
if status:
print('working', i)
break
if __name__ == '__main__':
second_function()
我建议使用multiprocessing.pool.Pool
来限制同时运行的进程数(因为您已经指出它们可能非常多)。
如果你使用它的apply_async()
方法向它“提交”任务,你可以使用可选的callback
参数来指定一个 function,只要其中一个子进程完成,就会调用它。 这提供了一种方法来终止提交到pool
的其他进程的进一步处理。
import multiprocessing as mp
import requests
def worker(i):
try:
response = requests.get(f'https://ru.hexlet.io/{i}')
if response.status_code == 200:
return i
except Exception as exc:
print(f'{i!r} caused {exc}')
return None
if __name__ == '__main__':
def notify(i):
"""Called when a Pool worker process finishes execution."""
if i is not None:
print(f'{i!r} worked')
pool.terminate() # Stops worker processes immediately.
pool = mp.Pool()
for i in [1,2,3,4,5,6,'courses',8,9,10]:
pool.apply_async(worker, (i,), callback=notify)
pool.close()
pool.join()
print('fini')
Output:
'courses' worked
fini
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.