HtmlAgilityPack can't find element

Question

I need to parse a site and I know where to find the element I'm searching: it's a span with class="metadata_with_icon-tags-primary_tag" .

My C# code:

var page = new HtmlWeb().Load(url).DocumentNode.Descendants("span").Where(d => d.Attributes.Contains("class") && d.Attributes["class"].Value.Contains("metadata_with_icon-tags-primary_tag"));

Item that I need:

Answer 1

Try this

HtmlWeb website = new HtmlWeb();
            var html = website.Load("https://genius.com/Eminem-space-bound-lyrics").DocumentNode.InnerHtml;  

            Regex rgx = new Regex(@"<script\b[^>]*>([\s\S]*?)<\/script>", RegexOptions.IgnoreCase);
            var matches = rgx.Matches(html);
            var g = matches[14].Value;

            Regex regex = new Regex(
                @"(\[{.*}\])",
                RegexOptions.Multiline
            );

            Match match = regex.Match(g);
            var json = match.Value;

Answer 2

要使用class="metadata_with_icon-tags-primary_tag"获取span ，请执行以下操作：

HtmlNode node = htmlDoc.DocumentNode.SelectSingleNode("//span[@class='metadata_with_icon-tags-primary_tag']");