拼凑的LOG_FILE和LOG_LEVEL设置不适用于每个蜘蛛

Question

I have several spiders in my project, and I want to log every spider in independent log file (such as brand.log, product.log ...).

So I use the custom_settings per spider, but it doesn't seem to work. Is it a bug until now? Is there any easy config can solve this problem?

Very thanks for your help!

Answer 1

It's working for me. Here is the spider inside a dummy project:

# -*- coding: utf-8 -*-
import scrapy

class ExampleSpider(scrapy.Spider):
    name = 'example'
    start_urls = ['http://example.com/']

    custom_settings = {
        'LOG_FILE': '/tmp/example.log',
    }

    def parse(self, response):
        self.logger.info('XXXXX')

I start the spider using scrapy crawl example and the log file is successfully written to /tmp/example.log .