簡體   English   中英

Scrapy教程扭曲錯誤

[英]Scrapy tutorial twisted error

我是Scrapy的新手,僅對python有基本了解。
運行Scrapy教程時遇到錯誤。
我安裝了Windows 7操作系統,64位和32位Python 2.7.12
到目前為止我已經采取的步驟

  • 按照安裝頁面執行的步驟並設置“ scrapy”虛擬環境
  • 激活虛擬環境
  • 已安裝scrapy(所有依賴項似乎也都安裝正確,包括pywin(32位版本))
  • 按照教程頁面運行步驟
  • scrapy startproject tutorial
  • 使用教程頁面上給出的代碼創建文件quotes_spider.py
  • 從scrapy \\ Scripts \\ tutorial我運行了scrapy crawl quotes並得到以下錯誤

     (scrapy) F:\\My Projects\\scrapy\\Scripts\\tutorial>scrapy crawl quotes 2016-11-05 14:21:59 [scrapy] INFO: Scrapy 1.2.1 started (bot: tutorial) 2016-11-05 14:21:59 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'tutorial.spiders', 'SPIDER_MODULES': ['tutorial.spiders'], 'ROBOTSTXT_OBEY': True, 'BOT_NAME': 'tutorial'} 2016-11-05 14:21:59 [scrapy] INFO: Enabled extensions:'scrapy.extensions.logstats.LogStats','scrapy.extensions.telnet.Telne tConsole', 'scrapy.extensions.corestats.CoreStats'] Unhandled error in Deferred: 2016-11-05 14:21:59 [twisted] CRITICAL: Unhandled error in Deferred: 2016-11-05 14:21:59 [twisted] CRITICAL: Traceback (most recent call last): File "f:\\myproj~1\\scrapy\\lib\\site-packages\\twisted\\internet\\defer.py", line 12 60, in _inlineCallbacks result = g.send(result) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\crawler.py", line 90, in crawl six.reraise(*exc_info) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\crawler.py", line 72, in crawl self.engine = self._create_engine() File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\crawler.py", line 97, in _create_engine return ExecutionEngine(self, lambda _: self.stop()) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\core\\engine.py", line 68, in __init__ self.downloader = downloader_cls(crawler) File "f:\\myproj~1\\scrapy\\lib\\site- packages\\scrapy\\core\\downloader\\__init__.py" , line 88, in __init__ self.middleware = DownloaderMiddlewareManager.from_crawler(crawler) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\middleware.py", line 58, in from_crawler return cls.from_settings(crawler.settings, crawler) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\middleware.py", line 34, in from_settings mwcls = load_object(clspath) File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\utils\\misc.py", line 44, in load_object mod = import_module(module) File "c:\\python27\\Lib\\importlib\\__init__.py", line 37, in import_module__import__(name) File "f:\\myproj~1\\scrapy\\lib\\site- packages\\scrapy\\downloadermiddlewares\\retry.py", line 23, in <module> from scrapy.xlib.tx import ResponseFailed File "f:\\myproj~1\\scrapy\\lib\\site-packages\\scrapy\\xlib\\tx\\__init__.py", line 3, in <module> from twisted.web import client File "f:\\myproj~1\\scrapy\\lib\\site-packages\\twisted\\web\\client.py", line 42, in <module> from twisted.internet.endpoints import TCP4ClientEndpoint, SSL4ClientEndpoint File "f:\\myproj~1\\scrapy\\lib\\site-packages\\twisted\\internet\\endpoints.py", line 36, in <module> from twisted.internet.stdio import StandardIO, PipeAddress File "f:\\myproj~1\\scrapy\\lib\\site-packages\\twisted\\internet\\stdio.py", line 30, in <module> from twisted.internet import _win32stdio File "f:\\myproj~1\\scrapy\\lib\\site- packages\\twisted\\internet\\_win32stdio.py", line 9, in <module> import win32api ImportError: No module named win32api 

這與此處討論的錯誤非常相似,但建議的解決方案似乎無法解決。 pywin已安裝在我的全局環境C:Python27 \\ Lib \\ site-packages中,但未在我的虛擬環境中顯示。 我不確定如何在虛擬環境中安裝它,因為pywin可執行文件似乎只允許在C下安裝。預先感謝您的幫助!

我在虛擬環境中的點子清單是
attrs == 16.2.0
cffi == 1.8.3
持續== 15.1.0
加密== 1.5.2
cssselect == 1.0.0
枚舉34 == 1.1.6
idna == 2.1
增量== 16.10.1
ip地址== 1.0.17
lxml == 3.6.4
parsel == 1.0.3
pyasn1 == 0.1.9
pyasn1-modules == 0.0.8
pycparser == 2.17
PyDispatcher == 2.0.5
pyOpenSSL == 16.2.0
queuelib == 1.4.2
Scrapy == 1.2.1
服務身份== 16.0.0
六個== 1.10.0
扭曲== 16.5.0
w3lib == 1.15.0
zope.interface == 4.3.2

似乎您缺少win32api,只需通過pip安裝它:

pip install pypiwin32

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM