如何在Java中规范化/抛光文本？

Question

What method would you suggest to normalizing a text in Java, for example

String raw = "  This is\n  a test\n\r  ";
String txt = normalize(raw);
assert txt == "This is a test";

I'm thinking about StringUtils .replace() and .strip() methods, but maybe there is some easier way.

Answer 1

如果只是空格，请尝试以下操作

String txt = raw.replaceAll("\\s+", " ").trim();

Answer 2

I see that you have a newline actually in the string that you want to get rid of. In which case I would recommend using a regex like so...

Pattern.compile("\\s+").matcher(text).replaceAll(" ").trim();

You can alway store the compiled regex for better performance.

Answer 3

depends a little on exactly what it is you want to strip. If its certain specific characters then replaceAll() would be the go as posted by @Yaneeve. If the needs are more general then you might want to look at normalize the string using the Normalizer .

Answer 4

Apache Commons最终添加了此功能： org.apache.commons.lang3.StringUtils.normalizeSpace(String str) // docs

Answer 5

To remove the first and the last spaces you're looking for String#trim()

http://download.oracle.com/javase/1.4.2/docs/api/java/lang/String.html#trim ()

Answer 6

If normalization means replacing sequences of spaces, tabs, newlines, and linefeeds, then I'd consider using a simple regular expression and String.split() to create separate words, then appending them in a StringBuilder with the spacing you'd like in between. If performance really matters, another approach would be to simply loop over the String's characters, looking at each one and deciding whether to append it to a StringBuilder or to discard it.

Answer 7

private static String normalize(String raw) {
    StringBuilder sb = new StringBuilder();
    Scanner scanner = new Scanner(raw);
    while (scanner.hasNext()) {
        sb.append(scanner.next());
        sb.append(' ');
    }
    sb.deleteCharAt(sb.length() - 1);
    return sb.toString();
}