我如何使用scrapy.Request正确的方法

Question

Im trying to make my crawler crawl the next page so I wrote this function:

    def requestURL(self, hrefPath):
        print(hrefPath)
        url =  "http://www.presseportal.de/" + hrefPath
        yield scrapy.Request(url, callback=self.parse)

Its not even printing the variable hrefPath so I suspect the function isnt called, although im pretty sure I called it right like this: self.requestURL(hrefPath)

Im very new to scrapy so Im very sorry if this question seems stupid

Answer 1

I figured it out: Instead of writing

yield scrapy.Request(url, callback=self.parse)

write return

yield scrapy.Request(url, callback=self.parse)

in the function and when you call the function in the parse function write: yield requestURL(hrefPath)