[英]Python, using threading with multiprocessing
有人可以解释为什么线程在 multiprocessing.Process 中不起作用。
我附上了一些例子来解释我的问题。
我有一个每秒执行一次并写入文件的进程。 当我从 shell 运行它时,它按预期工作。
stat_collect.py
#!/usr/bin/env python
# -*- coding: utf-8 -*-
from threading import Timer
from os import path
from datetime import datetime
STAT_DATETIME_FMT = '%Y-%m-%d %H:%M:%S'
def collect_statistics():
my_file = 'test.file'
if not path.exists(my_file):
with open(my_file, 'w') as fp:
fp.write(datetime.now().strftime(STAT_DATETIME_FMT) + '\n')
else:
with open(my_file, 'a') as fp:
fp.write(datetime.now().strftime(STAT_DATETIME_FMT) + '\n')
Timer(1, collect_statistics).start()
if __name__ == '__main__':
collect_statistics()
当我尝试从其他脚本运行它时(在后台工作):
#!/usr/bin/env python
from multiprocessing import Process
from stat_collect import collect_statistics # logger sc
if __name__ == '__main__':
# This don't work
p = Process(target=collect_statistics)
p.start()
while True:
pass
方法 collect_statistics 只执行一次,但如果我使用 Thread(target=collect_statistics).start() 它就像我从 shell 运行它一样。 为什么会这样?
这是发生了什么:
collect_statistics
运行collect_statistics
)已完成,因此进程退出,同时杀死计时器。以下是修复方法:
stat_collect.py
#!/usr/bin/env python
# -*- coding: utf-8 -*-
from threading import Timer
from os import path
from datetime import datetime
import time
STAT_DATETIME_FMT = '%Y-%m-%d %H:%M:%S'
def collect_statistics():
while True:
my_file = 'test.file'
if not path.exists(my_file):
with open(my_file, 'w') as fp:
fp.write(datetime.now().strftime(STAT_DATETIME_FMT) + '\n')
else:
with open(my_file, 'a') as fp:
fp.write(datetime.now().strftime(STAT_DATETIME_FMT) + '\n')
time.sleep(1)
if __name__ == '__main__':
collect_statistics()
对于调用脚本:
#!/usr/bin/env python
from multiprocessing import Process
from stat_collect import collect_statistics # logger sc
if __name__ == '__main__':
# This don't work
p = Process(target=collect_statistics)
p.start()
p.join() # wait until process is over, e.g forever
p.join()
只是在这里替换您的无限 while 循环,这会白白占用大量资源。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.