Get response from the request in Scrapy

Question

is there a way i can return a response from my parse method?

I tried this:

yield {
    'content': scrapy.Request(url, callback=self.parse_page),
}

but the response is:

'content': <GET https://example.com>

I expect the result would be like this:

'content': 'some text'

as the parse_page() method is parsing from some css selector.

Thank you and sorry for my bad english.

Answer 1

It is object:

scrapy.Request(url, callback=self.parse_page)

Parameter body, this is what you need:

response = scrapy.Request(url, callback=self.parse_page)
content = response.body
yield {
    'content': content,
}