下载HTML页面并将其编码为文件

Question

I like to download some web pages which use charset="UTF-8"
This page is a sample: http://en.wikipedia.org/wiki/Billboard_Year-End_Hot_100_singles_of_2003
I always end up with special characters like this: Beyoncé instead of Beyoncé
I tried the following code:

WebClient webClient = new WebClient();
webClient.Encoding = System.Text.Encoding.UTF8;
webClient.DownloadFile(url, fileName);

or this one:

WebClient client = new WebClient();
Byte[] pageData = client.DownloadData(url);
string pageHtml = Encoding.UTF8.GetString(pageData);
System.IO.File.WriteAllText(fileName, pageHtml);

What do I do wrong?
I just want an easy way to download web pages and write them to files. After that is done I will extract data from these files and obviously I want "normal" characters like I see on the original web-page and not some special characters.

Answer 1

The problem is that the WriteAllText Method don't write the encoded Text in UTF-8 in the File. You should add the Encoding:

System.IO.File.WriteAllText(fileName, pageHtml, Encoding.UTF8);