如何使用C ++更有效地摆脱停用词

Question

Now I have a stopword dict,and the wordlist need to be processed.How can I coding to imporve much effeciently?

My code is that:load dict into memory,using vectorstopword, and then iterator the wordlist,find if wordlist in stopword,if not in ,strcpy to newwordlist.

for(i=0;i<len;i++)
{  
   stopword.find(a[i])=stopword.end());
   strcpy(new_word,a[i]);
}  

But this code need to 2 loops?Can any other ways to imporve it?Using hash instead of vertor?

Answer 1

You can store your stopwords in a structure called Trie. It is a prefix-based tree that will enable you to search for all stopwords at once, character-by-character.

See Wikipedia: http://en.wikipedia.org/wiki/Trie