使用asp.net中的html敏捷性以及完整的HTML和CSS获取div的内容
[英]Get contents of div using html agility in asp.net along with complete HTML & css
问题描述
I need to scrape website & get Tennis Drawsheets i am trying to achive it with HTML Agility pack but so far i dont have any success. 
我需要抓取网站并获取网球抽奖单，我试图通过HTML Agility Pack实现它，但到目前为止，我没有任何成功。
Sample link of the scrape URL http://www.itftennis.com/procircuit/tournaments/women%27s-tournament/info.aspx?tournamentid=1100027528 抓取网址的示例链接http://www.itftennis.com/procircuit/tournaments/women%27s-tournament/info.aspx?tournamentid=1100027528
below is the code for .cs & HTML that i need to scrape & show on my website. 以下是我需要在网站上抓取并显示的.cs和HTML代码。
I also need title, description of the page but description always return null 我还需要标题，页面描述，但描述总是返回null
HtmlDocument doc = new HtmlDocument();
var url = txtURL.Text;
var webGet = new HtmlWeb();
doc = webGet.Load(url);
// doc.LoadHtml(response);
String title = (from x in doc.DocumentNode.Descendants()
where x.Name.ToLower() == "title"
select x.InnerText).FirstOrDefault();
String desc = (from x in doc.DocumentNode.Descendants()
where x.Name.ToLower() == "description"
select x.InnerText).FirstOrDefault();
List<String> imgs = (from x in doc.DocumentNode.Descendants()
where x.Name.ToLower() == "img"
select x.Attributes["src"].Value).ToList<String>();
//string drawsheet = (from x in doc.DocumentNode.InnerHtml where x.
lblTitle.Text = title;
lblDescription.Text = desc;
System.Text.StringBuilder sb = new System.Text.StringBuilder();
foreach (HtmlNode node in doc.DocumentNode.SelectNodes("//div[@id='divTourDrawsheets']"))
{
string text = node.InnerText; //that's the text you are looking for
}
sb.Append(text);
ltrDrawSheet.Text = sb.ToString();
* Part of HTML code as i had to remove most of it as it exceed 30000 characters * * HTML代码的一部分，因为超过30000个字符，我不得不删除其中的大部分*
<div style="overflow:hidden;" id="divTourDrawsheets">
<title></title>
<style type="text/css">
#divDrawsheet {font-size:0.9em; overflow:auto; margin-left:10px; cursor:move; /*width:1500px;*/ width:2000px;} /*Width set at 1000px for IE7*/
.divWinner1S {margin-top:28px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.divWinner1D {margin-top:50px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.liQWRnd1S {margin-top:28px; margin-bottom:-11px;}
.liQWRnd1D {margin-top:30px; height:47px;}
.tDetail .liRnd2S {padding:22px 0px 0px 0px;}
.divRnd2S {border-right:1px solid #999; text-align:center; padding:4px 0px 6px 0px; height:18px;}
.divWinner2S {margin-top:63px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.liQWRnd2S {margin-top:53px; margin-bottom:73px;}
.tDetail .liRnd2D {padding:30px 0px 6px 0px;}
.divRnd2D {border-right:1px solid #999; text-align:center; padding:12px 0px 10px 0px; height:18px;}
.divWinner2D {margin-top:85px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd3S {padding:49px 0px 27px 0px;}
.divRnd3S {border-right:1px solid #999; text-align:center; padding:39px 0px 29px 0px; height:18px;}
.divWinner3S {margin-top:114px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.liQWRnd3S {margin-top:112px; margin-bottom:185px;}
.tDetail .liRnd3D {padding:72px 0px 46px 0px;}
.divRnd3D {border-right:1px solid #999; text-align:center; padding:52px 0px 48px 0px; height:18px;}
.divWinner3D {margin-top:165px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd4S {padding:107px 0px 83px 0px;}
.divRnd4S {border-right:1px solid #999; text-align:center; padding:90px 0px 88px 0px; height:18px;}
.divWinner4S {margin-top:225px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.liQWRnd4S {margin-top:220px; margin-bottom:410px;}
.tDetail .liRnd4D {padding:154px 0px 122px 0px;}
.divRnd4D {border-right:1px solid #999; text-align:center; padding:134px 0px 130px 0px; height:18px;}
.divWinner4D {margin-top:325px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd5S {padding:220px 0px 196px 0px;}
.divRnd5S {border-right:1px solid #999; text-align:center; padding:200px 0px 200px 0px; height:18px;}
.divWinner5S {margin-top:445px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd5D {padding:316px 0px 250px 0px;}
.divRnd5D {border-right:1px solid #999; text-align:center; padding:295px 0px 295px 0px; height:18px;}
.divWinner5D {margin-top:645px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd6S {padding:443px 0px 352px 0px;}
.divRnd6S {border-right:1px solid #999; text-align:center; padding:426px 0px 425px 0px; height:18px;}
.divWinner6S {margin-top:895px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd6D {padding:630px 0px 300px 0px;}
.divRnd6D {border-right:1px solid #999; text-align:center; padding:620px 0px 610px 0px; height:18px;}
.divWinner6D {margin-top:1285px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.tDetail .liRnd7S {padding-top:890px;}
.divRnd7S {border-right:1px solid #999; text-align:center; padding:880px 0px 800px 0px; height:18px;}
.divWinner7S {margin-top:1795px; border-bottom:1px solid #999; padding:0px 3px 2px 3px;}
.RRTable {background-color:#fff;}
.RRTable td:empty{background-color:#ddd;}
</style>
<span id="spnNote">(Use the cursor to move the drawsheet)</span><span style="float:right; padding:10px;" id="spnPrintDS"><a style="cursor:pointer;" onclick="printableDrawsheet();"><img align="absbottom" style="border-width:0px;" alt="Print Drawsheet" src="/itf/images/printDS-icon.png" id="imgPrint"></a></span>
<div id="divDrawsheet" style="position: relative;" class="ui-draggable">
<div class="fl"><ul id="ulRounds">
<li class="fl" id="liRound">
<div style="padding:10px 3px 10px 3px; min-width:125px; text-align:center;font-size:1.2em;" id="divRound"><strong>Round 1</strong></div>
<ul id="ulEntry">
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14CZE" title="Czech Republic" alt="Czech Republic" src="/ITF/Images/pixel.gif">
<a class="drsh100057386" href="/procircuit/players/player/profile.aspx?playerid=100057386">Katerina VANKOVA</a></span> (CZE) [1]
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a disabled="disabled" id="lnkHeadToHead"></a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft" id="spnPlayerBottom1Bye"><img height="11px" width="14px" border="0" src="/itf/images/pixel.gif">BYE</span>
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100149370" href="/procircuit/players/player/profile.aspx?playerid=100149370">Kyria DUNFORD</a></span> (GBR)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100149370&player2=100073050" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100073050" href="/procircuit/players/player/profile.aspx?playerid=100073050" style="background-color:transparent;">Hollie BEES</a></span> (GBR)
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100141485" href="/procircuit/players/player/profile.aspx?playerid=100141485">Sophie WATTS</a></span> (GBR)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100141485&player2=100084615" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14CZE" title="Czech Republic" alt="Czech Republic" src="/ITF/Images/pixel.gif">
<a class="drsh100084615" href="/procircuit/players/player/profile.aspx?playerid=100084615" style="background-color:transparent;">Martina PRADOVA</a></span> (CZE)
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft" id="spnPlayerTop1Bye"><img height="11px" width="14px" border="0" src="/itf/images/pixel.gif">BYE</span>
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a disabled="disabled" id="lnkHeadToHead"></a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14BLR" title="Belarus" alt="Belarus" src="/ITF/Images/pixel.gif">
<a class="drsh100128240" href="/procircuit/players/player/profile.aspx?playerid=100128240" style="background-color:transparent;">Aliaksandra SASNOVICH</a></span> (BLR) [7]
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14RUS" title="Russia" alt="Russia" src="/ITF/Images/pixel.gif">
<a class="drsh100134744" href="/procircuit/players/player/profile.aspx?playerid=100134744" style="background-color:transparent;">Mayya KATSITADZE</a></span> (RUS) [2]
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a disabled="disabled" id="lnkHeadToHead"></a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft" id="spnPlayerBottom1Bye"><img height="11px" width="14px" border="0" src="/itf/images/pixel.gif">BYE</span>
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14FIN" title="Finland" alt="Finland" src="/ITF/Images/pixel.gif">
<a class="drsh100152949" href="/procircuit/players/player/profile.aspx?playerid=100152949">Mia Nicole EKLUND</a></span> (FIN)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100152949&player2=100151646" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100151646" href="/procircuit/players/player/profile.aspx?playerid=100151646">Lauren MCMINN</a></span> (GBR)
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100139057" href="/procircuit/players/player/profile.aspx?playerid=100139057">Jazzamay DREW</a></span> (GBR)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100139057&player2=100143216" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100143216" href="/procircuit/players/player/profile.aspx?playerid=100143216">Brigit FOLLAND</a></span> (GBR)
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft" id="spnPlayerTop1Bye"><img height="11px" width="14px" border="0" src="/itf/images/pixel.gif">BYE</span>
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a disabled="disabled" id="lnkHeadToHead"></a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14IRL" title="Ireland" alt="Ireland" src="/ITF/Images/pixel.gif">
<a class="drsh100119788" href="/procircuit/players/player/profile.aspx?playerid=100119788">Amy BOWTELL</a></span> (IRL) [5]
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14FRA" title="France" alt="France" src="/ITF/Images/pixel.gif">
<a class="drsh100090878" href="/procircuit/players/player/profile.aspx?playerid=100090878">Constance SIBILLE</a></span> (FRA) [3]
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a disabled="disabled" id="lnkHeadToHead"></a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft" id="spnPlayerBottom1Bye"><img height="11px" width="14px" border="0" src="/itf/images/pixel.gif">BYE</span>
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100141443" href="/procircuit/players/player/profile.aspx?playerid=100141443">Anneka WATTS</a></span> (GBR)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100141443&player2=100053033" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14USA" title="USA" alt="USA" src="/ITF/Images/pixel.gif">
<a class="drsh100053033" href="/procircuit/players/player/profile.aspx?playerid=100053033">Tori KINARD</a></span> (USA)
</span>
</div>
</li>
<li style="padding:4px 0px 0px 0px;" id="liEntry">
<div class="hlPlayer" style="border-bottom:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerTop">
<span style="display:block; height:12px;">
<span class="flagLeft">
<img class="flag14 f14GBR" title="Great Britain" alt="Great Britain" src="/ITF/Images/pixel.gif">
<a class="drsh100139660" href="/procircuit/players/player/profile.aspx?playerid=100139660">Edita RACA</a></span> (GBR)
</span>
</div>
<div style="border-right:1px solid #999; text-align:center; padding:6px 0px 1px 0px; height:15px;"><i><a href="/procircuit/players/head-to-head/result.aspx?player1=100139660&player2=100131722" id="lnkHeadToHead">H2H</a><span style="color:#fff;">|</span></i></div>
<div class="hlPlayer" style="border-bottom:1px solid #999; border-right:1px solid #999; padding:0px 3px 2px 3px;" id="divPlayerBottom">
<span style="display:block; height:12px;">
</div>
</div>
</div>
1 个解决方案
解决方案1
1 2012-11-05 12:30:33
I assume by "description" you mean the meta tag. 我假设“描述”是指meta标签。
Probably the best way to get this would be to use an xpath expression like this 可能最好的方法是使用像这样的xpath表达式
HtmlNode descNode = doc.DocumentNode.SelectSingleNode("//meta[@name='description']");
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
使用 ASP.NET 隐藏 HTML Div - Using ASP.NET to Hide an HTML Div
HTML Agility Pack（asp.net）中是否有与“ .nextUntil”（jQuery）等效的东西？ - Is there any equivalent of “.nextUntil” (Jquery) in Html Agility pack (asp.net)?
在asp.net核心中获取完整的HTML正文 - Get complete Html Body on post in asp.net core
ASP.NET获取HTML输入框的内容 - Asp.net get contents of HTML input box
使用 asp.net 将 html 文件完成到 pdf 文件中 - Complete html file in to pdf file by using asp.net
HTML Agility Pack从表中获取内容 - Html Agility Pack get contents from table
无法在服务器上的asp.net中获取div的内部html - Cannot get inner html of a div in asp.net on server
使用 html 敏捷包获取 div 信息 - get div information with html agility pack
使用html敏捷性来获取此节点的值 - using html agility to get the value of this node
使用HTML Agility Pack替换HTML div InnerText标记 - Replacing a HTML div InnerText tag using HTML Agility Pack
相关标签