（Web）使用C＃中的正则表达式从某些div抓取内容

Question

WebClient web = new WebClient();
String website = web.DownloadString("https://www.google.com");

String search = @"";
MatchCollection matches = Regex.Matches(Website,Search);

foreach (Match m in matches){}

This is what I use to scrape a website (I don't know if this is the best way, if not I'm interested in learning other ways)

My problem is the search string using regex I can by example find ever word that follows title= . But I only want to extract it when it's in a certain div and I don't know if I can do it this way.

Thanks

Answer 1

是的，正如Wiktor提到的那样，请尝试对HTMl和静态页面使用HtmlAgilityPack，或者使用某些浏览器自动化功能-Selenium Chrome或无头PhantomJS-以防万一，如果您托管网站，那么其中很多Java代码和内容都是动态生成的。