简体   繁体   中英

Crawl data from next page doesn't change URL

i'm trying to change pages in this site to crawl information. But it doesn't change URL when I click next page:

My code until now:

[...]
paging = response.css('span id.next::attr(href)').extract()
    if paging:
        yield scrapy.Request(paging, callback=self.parse_links) 

I don't know how to crawl from site like this. Please help me, thank you

Network next page request You can try this request for the next page http://vsd.vn/ModuleArticles/ArticlesList/NextPageHDNVTCPH?pCurrentPage=2

This is return next page data

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM