在大文本句子语料库中搜索句子

Question

I am a beginner and I want to know if there's way to search a text sentence in a large text sequence of data (say 1 million) and search accordingly like when a user type:

I shouldn't be there

then it should search for sequence like this:

I should not be there

similar like this :

I gonna go there.

to

I going to go there.

I have been thinking for couple of days to figure out solution of this problem.

If you know anything about how to deal with this problem then please provide a solution or just a hint would be more than enough. Thank you.

Answer 1

I would firstly go trough both the sentence and text and replace all contractions with the long form. Then after that use Knuth-Morris-Pratt.