字符编码，如何区分？

Question

Characters coming out of my database are encoded differently than the same characters written directly in the source. For exmaple, the word Permissões shows a different result when the string is written directly in the HTML, than when the string is output from a db record.

# From the source
Addressable::URI.encode("Permissões.pdf") #=> "Permiss%C3%B5es.pdf"

# From the db
Addressable::URI.encode("Permissões.pdf") #=> "Permisso%CC%83es.pdf"

The encodings are different. But my database is set to UTF-8 , and I am using HTML5. What could be causing this?

I am unable to download files I upload to S3 because of this issue. I tried to force the encoding attachment.path.encode("UTF-8") but that makes no diffrence.

Answer 1

To solve this, since I am using Rails, I used ActiveSupport::Multibyte::Unicode to normalize any unicode characters before they get inserted into the database.

before_save do
  self.path = ActiveSupport::Multibyte::Unicode.normalize(path)
end