从列表中删除与子字符串匹配的项目的最快方法 - Python

Question

删除列表中与集合中的子字符串匹配的项目的最快方法是什么？

例如，

the_list =
['Donald John Trump (born June 14, 1946) is an American businessman, television personality',
 'and since June 2015, a candidate for the Republican nomination for President of the United States in the 2016 election.',
 'He is the chairman and president of The Trump Organization and the founder of Trump Entertainment Resorts.',
 'Trumps career',
 'branding efforts',
 'personal life',
 'and outspoken manner have made him a celebrity.',
 'Trump is a native of New York City and a son of Fred Trump, who inspired him to enter real estate development.',
 'While still attending college he worked for his fathers firm',
 'Elizabeth Trump & Son. Upon graduating in 1968 he joined the company',
 'and in 1971 was given control, renaming the company The Trump Organization.',
 'Since then he has built hotels',
 'casinos',
 'golf courses',
 'and other properties',
 'many of which bear his name. He is a major figure in the American business scene and has received prominent media exposure']

该列表实际上比这个（数百万个字符串元素）要长很多，并且我想删除包含该集合中字符串的任何元素，例如，

{"Donald Trump", "Trump Organization","Donald J. Trump", "D.J. Trump", "dump", "dd"} 

什么是最快的方式？ 循环最快？

Answer 1

如果你的字符串已经在内存中，请使用列表解析：

new = [line for line in the_list if not any(item in line for item in set_of_words)]

如果在内存使用方面没有将它们作为更优化的方法在内存中使用，则可以使用生成器表达式：

new = (line for line in the_list if not any(item in line for item in set_of_words))

Answer 2

Aho-Corasick算法专门针对此任务而设计。 它具有比嵌套循环O（n * m）低得多的时间复杂度O（n + m）的明显优点，其中n是要查找的字符串的数量，m是要搜索的字符串的数量。

有一个很好的Python实现Aho-Corasick及附带的解释。 Python Package Index也有一些实现，但我没有看过它们。