如何在C＃中获取网页的完整源代码？

Question

I am working on a little project and it involves getting data from a website to calculate stuff.

I tried

    HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
    HttpWebResponse response = (HttpWebResponse)request.GetResponse();
    StreamReader sr = new StreamReader(response.GetResponseStream());
    rtb_data.Text = sr.ReadToEnd();
    sr.Close();

But this way, I dont get the full source code, like I do when I open the developer kit on chrome for instance (F12).

Example:

    <div id="live-match" class="panel-container" data-match-status-code="6" data-mode="3">

I get:

    <div id="live-match" class="panel-container">

in that div are many important information but I dont get the classes at all.

I am no pro with C# or dynamic webpages but since I am able to see the real source code with the developer kit, it should be possible to get it in C# too, right?

My last solution would be to work with the copy/paste source code and work from there but that would be really slow since I wanna automatically calculate stuff.

Do you guys have any idea how I can get the full source code? Do I have to temp download the content maybe? If yes, how?

Answer 1

The problem you have is that you don't want the source of the web page (that is what you get when you do your simple web request) You seem to actually be after the DOM that is generated at runtime.

Unfortunately, unless you are willing to write your own browser...