Custom JSON Response from Scrapy Spider Deployed via Scrapyd

Question

I need to find a way to make my Scrapy spider return a custom JSON response. It is deployed via scrapyd using schedule.json . Schedule.json responds with JobID and Status , but I'd like to add some more data to that response.

If there's a way I could do it by creating a separate response and then make a separate request that would work as well.

Much appreciated!

Answer 1

^{(taken from Learn to Read the Source, Luke ).}

It is doable.

Implement your own resource based on scrapyd.webservice.WsResource , write a render_POST() method. Then, tell scrapyd to use your schedule.json resource implementation:

[services]
schedule.json = project.module.MySchedule