繁体   English   中英

在Scrapy演示中,无法将ImagePipeline添加到settings.py

[英]In a Scrapy Demo,ImagePipeline can't be added into settings.py

在我的Scrapy Demo中,该类扩展了ImagesPipelines,无法将其添加到settings.py中。 这是我的pipelines.py:

class Douyu3Pipeline(ImagesPipeline):

    IMAGES_STORE = get_project_settings().get("IMAGE_STORE")

    def get_media_requests(self, item, info):
        print("1---------------------------1")
        image_url = item["imagelink"]
        yield scrapy.Request(image_url)

    def item_completed(self, results, item, info):
        image_path = [x["path"] for ok, x in results if ok]
        os.rename(self.IMAGES_STORE + "/" + image_path[0],
                  self.IMAGES_STORE + "/" + item["nickname"] + ".jpg")
        item['imagePath'] = self.IMAGES_STORE + '/' + item['nickname']
        return item

这是我的settings.py:

BOT_NAME = 'douyu3'
SPIDER_MODULES = ['douyu3.spiders']
NEWSPIDER_MODULE = 'douyu3.spiders'
ROBOTSTXT_OBEY = True
DEFAULT_REQUEST_HEADERS = {
    'User-Agent': 'DYZB/1 CFNetwork/808.2.16 Darwin/16.3.0',
}
ITEM_PIPELINES = {
   "douyu3.pipelines.Douyu3Pipeline": 1,
}
IMAGE_STORE = "/Users/enritami/desktop/SearchEngineer/douyu3/Images"

错误输出是ITEM_PIPELINES中没有图像,请在此处输入图像描述

settings.py中的IMAGE_STORE应该定义为IMAGES_STORE

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM