在应用程序内抓取抓取网站
[英]Crawl website with scrapy within application
问题描述
I am developing an application to crawl websites using Scrapy .I had a problem I want run the scrapy crawl website command within the application. 
我正在开发一个使用scrapy crawl website的应用程序。我有一个问题想要在应用程序中运行scrapy crawl website命令。 Because the crawler will run from the browser. 因为搜寻器将通过浏览器运行。
Any Ideas ?? 有任何想法吗 ？？
1 个解决方案
解决方案1
1 已采纳 2015-11-04 09:59:21
You should call a command from within your Python code. 您应该在Python代码中调用命令。 See here how that's done: Calling an external command in Python 查看此处的操作方法： 在Python中调用外部命令
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
Scrapy-抓取并抓取网站 - Scrapy - Crawl and Scrape a website
抓取抓取网站 - scrapy crawl a website
Python Scrapy无法抓取网站 - Python Scrapy does not crawl website
使用scrapy从值列表中抓取网站 - Crawl website from list of values using scrapy
如何使用Scrapy抓取具有分页的网站？ - How to crawl a website that has pagination using Scrapy?
Scrapy通过IP地址抓取本地网站 - Scrapy crawl a local website by IP address
登录后进行Scrapy递归网站爬网 - Scrapy recursive website crawl after login
在遵循之前先抓取整个网站 - Scrapy crawl entire website before follow
无法使用刮spider的蜘蛛抓取特定网站的元素 - Failed to crawl element of specific website with scrapy spider
从RSS抓取新闻网站 - Crawl news website from rss with scrapy
相关标签