Java正则表达式匹配开始/结束标签导致堆栈溢出

Question

The standard implementation of the Java Pattern class uses recursion to implement many forms of regular expressions (eg, certain operators, alternation).

This approach causes stack overflow issues with input strings that exceed a (relatively small) length, which may not even be more than 1,000 characters, depending on the regex involved.

A typical example of this is the following regex using alternation to extract a possibly multiline element (named Data ) from a surrounding XML string, which has already been supplied:

<Data>(?<data>(?:.|\r|\n)+?)</Data>

The above regex is used in with the Matcher.find() method to read the "data" capturing group and works as expected, until the length of the supplied input string exceeds 1,200 characters or so, in which case it causes a stack overflow.

Can the above regex be rewritten to avoid the stack overflow issue?

Answer 1

Some more details on the origin of the stack overflow issue :

Sometimes the regex Pattern class will throw a StackOverflowError . This is a manifestation of the known bug #5050507 , which has been in the java.util.regex package since Java 1.4. The bug is here to stay because it has "won't fix" status. This error occurs because the Pattern class compiles a regular expression into a small program which is then executed to find a match. This program is used recursively, and sometimes when too many recursive calls are made this error occurs. See the description of the bug for more details. It seems it's triggered mostly by the use of alternations.

Your regex (that has alternations) is matching any 1+ characters between two tags.

You may either use a lazy dot matching pattern with the Pattern.DOTALL modifier (or the equivalent embedded flag (?s) ) that will make the . match newline symbols as well:

(?s)<Data>(?<data>.+?)</Data>

See this regex demo

However, lazy dot matching patterns still consume lots of memory in case of huge inputs. The best way out is to use an unroll-the-loop method :

<Data>(?<data>[^<]*(?:<(?!/?Data>)[^<]*)*)</Data>

See the regex demo

Details :

• <Data> - literal text <Data>
• (?<data> - start of the capturing group "data"
  • [^<]* - zero or more characters other than <
  • (?:<(?!/?Data>)[^<]*)* - 0 or more sequences of:
    • <(?!/?Data>) - a < that is not followed with Data> or /Data>
    • [^<]* - zero or more characters other than <
• ) - end of the "data" group
• </Data> - closing delimiter