R-标记化-TermDocumentMatrix中的单个和两个字母词

Question

I am currently trying to do a little bit of text processing and I would like to get the one and two letter words in a TermDocumentMatrix.

The issue is that it seems to display only 3 letter words and more.

    library(tm)
    library(RWeka)

    test<-'This is a test.'

    testmyCorpus<-Corpus(VectorSource(test))
    testTDF<-TermDocumentMatrix(testmyCorpus, control=list(tokenize=AlphabeticTokenizer))
    inspect(testTDF)

Only the words "this" and "test" are displayed. Any ideas?

Thanks a lot for you help! Robert

Answer 1

这是几乎解决您问题的答案：简而言之，您应该在control=list(wordLengths=c(1,Inf)添加一个control=list(wordLengths=c(1,Inf) 。