如何修复一无所有的刮scrap蜘蛛

Question

the following spider creates a blank .xml file when run instead of one containing the items needed, can you spot the mistake(s)?

Please note, I'm an absolute amateur so using Occam's razor may be the easiest solution.

Spider code in arakaali.py:

import scrapy
from PoExtractor.items import PoextractorItem


class RedditSpider(scrapy.Spider):
    name = "arakaali"
    start_urls = [
        "https://pathofexile.gamepedia.com/Araku_Tiki"
    ]

    def parse(self, response):
            item = PoextractorItem()
            item["item_name"] = selector.xpath("//*[@id='mw-content-text']/span/span[1]/span[1]/text()[1]").extract()
            item["flavor_text"] = selector.xpath("//*[@id='mw-content-text']/span/span[1]/span[2]/span[3])").extract()
            yield item

Code of items.py:

import scrapy


    class PoextractorItem(scrapy.Item):

        flavor_text = scrapy.Field()
        item_name = scrapy.Field()
        pass

Then I use the command scrapy crawl arakaali but the result is a blank document.

The page I'm trying to extract data from is https://pathofexile.gamepedia.com/Araku_Tiki

Thanks in advance for any help.

Answer 1

Somehow instead of response you use selector variable which is not defined, but you should get an error when run that code.

UPDATE :

You have an error in second xpath "//*[@id='mw-content-text']/span/span[1]/span[2]/span[3])" and should remove the last bracket in the expression (after span[3] )