Scrapy-每个项目使用不同的管道

Question

I'm new with scrapy and python so forgive my ignorance about this.

I need to store in a database two different type of items. For one of them I need to do some extra queries before I do the insert. Is it possible to have a different pipeline based on the Item? If not, how can I differentiate which item is which when the get to the pipeline?

Answer 1

Basically you can discard the item that you don't wanna process in certain pipeline and vice ver sa. For example:

class ApplePipeLine(object):

    def process_item(self, item, spider):
        if not isinstance(item, Apple):
            return item
        # Do something with Apple
        return item


class OrangePipeLine(object):

    def process_item(self, item, spider):
        if not isinstance(item, Orange):
            return item
        # Do something with Orange
        return item