捕获JavaScript生成的内容

Question

The web page is using JavaScript to put content on the page, so then I got plain HTML there is no data on the page. I need somerthing that will not only read the HTML, but also will execute and apply JavaScript to DOM, and only then return result as HTML text.

The task is exactly same as in this question , but I'm looking a solution for .NET.

Answer 1

I'll be surprised if you find anything like that for .NET. I would use PhantomJS to open the page and interact with the DOM. It's a highly scriptable headless WebKit browser and will do exactly what you want with ease. See How to print html source to console with phantomjs for an example.

var page = require('webpage').create();
page.open('http://google.com', function () {
    console.log(page.content);
    phantom.exit();
});

You'll have to install PhantomJS and then launch a separate process to run your script, but PhantomJS will probably do a much better job than anything you can find written for .NET.