从网页中获取一些数据

Question

I have used this tutorial to fetch all the content of some webpage via c# code .

I now want to gather into an IEnumerable collection all the strings which are decorated in the following text pattern: (ie MY-TEXT)

data-address=" MY-TEXT "></

How can I do that? I tried using "string.split()" but got to many "white noises".

Any idea?

Answer 1

A better solution is to use HtmlAgilityPack and let it handle the parsing/scraping for you. Here is an example:

var web = new HtmlWeb();
var doc = web.Load("http://www.stackoverflow.com");

var nodes = doc.DocumentNode.SelectNodes("//[@data-address]");

foreach (var node in nodes)
{
    Console.WriteLine(node.Attributes["data-address"].Value);
}

This will fetch stackoverflow.com, find all elements which has a data-address attribute and then print the value of that attribute.

Answer 2

如果页面格式正确，则将内容加载到XDocument中，并使用LINQ to XML在其上进行查询。

Answer 3

@alexn is right. A small correction though:

  var nodes = doc.DocumentNode.SelectNodes("//*[@data-address]");

added the *