java中的垃圾字符删除

Question

In text field if i copy from word , junk character get inserted. While posting parameters from jsp page it remains fine. But while getting the parameter in java it converts into junk. I have used the following code to eliminate junk before insertion. I am using mysql database. (JBOSS 5.1 GA server)

String outputEncoding = "UTF-8";

Charset charsetOutput = Charset.forName(outputEncoding);
CharsetEncoder encoder = charsetOutput.newEncoder();
byte[] bufferToConvert = userText.getBytes();
CharsetDecoder decoder =  (CharsetDecoder) charsetOutput.newDecoder();
try {
    CharBuffer cbuf = decoder.decode(ByteBuffer.wrap(bufferToConvert));
    ByteBuffer bbuf = encoder.encode(CharBuffer.wrap(cbuf));
    userText = decoder.decode(bbuf).toString();
} catch (CharacterCodingException e) {
    e.printStackTrace();
}

but I am still getting junk character for single quote('') and double quotes(""). I need the string in UTF-8. Can anyone suggest where i may be wrong?

Example: Input -"esgh”. output - â??esghâ?? : Wanted Output - "esgh”.

Answer 1

You have to swap around the encode and decode calls. Plus; you are decoding twice, for only one encoding!

You wrote:

CharBuffer cbuf = decoder.decode(ByteBuffer.wrap(bufferToConvert));
ByteBuffer bbuf = encoder.encode(CharBuffer.wrap(cbuf));
userText = decoder.decode(bbuf).toString();

But, obviously, it has to be:

ByteBuffer bbuf = encoder.encode(CharBuffer.wrap(userText));
CharBuffer cbuf = decoder.decode(bbuf);
userText = cbuf.toString();

First, you have to encode your text, then decode the encoded result.

Answer 2

If you copy text from Microsoft Word, it has the 'Smart Quotes' feature that can and will trip up sometimes when encoding/decoding. Try using encoding Windows-1252 as source encoding. Also, I would suggest using String#getBytes(String) and String#String(byte[],Charset) for the conversions, no need to mess with buffers at this level.

Answer 3

The answer by Martijn Courteaux should give you the expected output. But once try with the server setup CHARACTER and COLLATION .Set to UTF-8 .

I hope it will work.

Answer 4

Please check if web/application server is sending the correct data.

Which web/application server are you using?

Are you using a simple text field or any other?