[英]How to get back to the previous spider in Scrapy
I'm trying to do one thing. 我正在尝试做一件事。 I have a spider written using Scrapy.
我有一个用Scrapy编写的蜘蛛。 It has two parse function like the following
它具有两个解析函数,如下所示
def parse(self, response):
...
for var in dict
...
scrapy.Request(link + var, callback=self.parse_info)
def parse_info(self, response)
...
do something
What I would like to do is getting data in parse_info
and after finished come back to the parse method to continue the iteration. 我想做的是在
parse_info
获取数据,完成后返回parse方法以继续迭代。 Does exist a way to do this in scrapy? 有没有办法做到这一点?
You will use 'Yield' in your parse call and 'return' in your parse_info call 您将在parse调用中使用“ Yield”,并在parse_info调用中使用“ return”
def parse(self, response):
...
for var in dict
...
yield Request(item['page_url'], callback=self.parse_info)
def parse_info(self, response)
...
do something
return something
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.