从下一页抓取数据不会更改URL

Question

i'm trying to change pages in this site to crawl information. But it doesn't change URL when I click next page:

My code until now:

[...]
paging = response.css('span id.next::attr(href)').extract()
    if paging:
        yield scrapy.Request(paging, callback=self.parse_links) 

I don't know how to crawl from site like this. Please help me, thank you

Answer 1

Network next page request You can try this request for the next page http://vsd.vn/ModuleArticles/ArticlesList/NextPageHDNVTCPH?pCurrentPage=2

This is return next page data