在这种情况下，如何在python中使用线程池

Question

假设我要在文件的每一行中处理彼此之间不依赖的字符串。 我通常的做法：

def process_line(filelines, i):
    #process lines
import threading
threads = []
lines = open(file).readlines()
for i in range(0,len(lines)):
    threads.append(threading.Thread(target=process_line, args=(lines,i,))

[t.start() for t in threads]
[t.join() for t in threads]

Answer 1

from concurrent.futures import ThreadPoolExecutor

with ThreadPoolExecutor() as executor:
    [executor.submit(proccess_line, lines, i) for i in range(len(lines))]

ThreadPoolExecutor文档： https : //docs.python.org/3/library/concurrent.futures.html

请注意，对于这些类型的任务，最好使用进程代替线程（用ProccessPoolExecutor替换ThreadPoolExecutor