使用多重处理在python中实现函数

Question

我使用的函数花了太多时间才能完成，因为它需要大量的输入并使用两个嵌套的for循环。

该函数的代码：

def transform(self, X):
        global brands
        result=[]
        for x in X:
            index=0
            count=0
            for brand in brands:
                all_matches= re.findall(re.escape(brand), x,flags=re.I)
                count_all_match=len(all_matches)
                if(count_all_match>count):
                    count=count_all_match
                    index=brands.index(brand)

            result.append([index])
        return np.array(result)

那么如何更改此函数的代码，使其使用多重处理来优化运行时间？

Answer 1

我看不到self在方法transform 。 所以我做了一个共同的功能。

import re
import numpy as np

from concurrent.futures import ProcessPoolExecutor

def transformer(x):

    global brands

    index = 0
    count = 0

    for brand in brands:

        all_matches = re.findall(re.escape(brand), x, flags=re.I)

        count_all_match = len(all_matches)

        if count_all_match > count:

            count = count_all_match

            index = brands.index(brand)

    return [index]

def transform(X):

    with ProcessPoolExecutor() as executor:
        result = executor.map(transformer, X)

    return np.array(list(result))