Java lucene standard analyzer`s default delimiters?

Question

i am looking for all the delimiters on which java lucene standard analyzer tokenizes the input string.

need to know all delimiters that are by default used for tokenizing.

Answer 1

I know (from Lucene in Action) that all characters which are not a-zA-Z or variatons of a-zA-Z that have diacritics are used as delimiters, including numbers.
So you might have Mc'Donald splitted in "Mc" "Donald", you might have "Web2.0" tokenized as "Web", and so on.
The best is to do a test and enter all kinds of characters and then post your results here.