Perl中正则表达式中格式错误的UTF-8字符错误

Question

I have 'Malformed UTF-8 character' error when I'm putting some scalar data in XML::Simple or Data::Dumper. There are regular expressions on the lines where the error occurs.

Malformed UTF-8 character (fatal) at /usr/share/perl5/XML/Simple.pm line 1690.
Malformed UTF-8 character (fatal) at /usr/lib/perl/5.10/Data/Dumper.pm line 682.

At the moment I failed to reproduce the error with a small piece of code.

XML::Simple 2.18
Data::Dumper 2.124
perl v5.10.1

Answer 1

之所以出现此问题，是因为在应用程序代码的某个深处，是带有标量的Encode::_utf8_on ，这不是正确的UTF-8字符串。

Answer 2

You could try piping your data through Encoding::FixLatin . If the 'binary' bytes you're encountering are actually Latin-1 characters then they'll get converted to valid UTF8. If they really are random binary bytes then they should at least get converted to random (but valid) UTF8 characters :-)

Answer 3

The core Encode module provides facilities for Handling Malformed Data . I never used them myself, though.