使用Storm搜寻器可以同时运行多少个搜寻器
[英]How many Crawlers can run simultaneously using storm crawler
问题描述
I am working on StormCrawler 1.10,archetype 1.11 and Elastic Search 6.4.x. 
我正在使用StormCrawler 1.10，原型1.11和Elastic Search6.4.x。 How many crawlers can run simultaneously. 可以同时运行多少个搜寻器。
1 个解决方案
解决方案1
0 已采纳 2018-10-31 07:31:01
Crawlers == topologies? 爬虫==拓扑？ As many as you want as long as they have different names. 只要它们具有不同的名称，就可以任意选择。 Why do you need multiple topologies? 为什么需要多个拓扑？ You can have a single one dealing with multiple sites 您可以拥有一个处理多个站点的站点
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
使用Storm Crawler进行爬网 - Crawling using Storm Crawler
如何使用Postgres设置风暴搜寻器？ - How to setup storm crawler with Postgres?
如何开始使用Storm-Crawler - How to get started with Storm-crawler
如何将 Storm Crawler 连接到 Elastic？ - How do I connect storm crawler to elastic?
如何调试Storm Crawler解析过滤器 - How to debug Storm Crawler parse filter
如何让搜寻器必须在页面中运行JavaScript？ - How to let crawlers have to run javascript in pages?
调试Storm Crawler - Debugging Storm Crawler
我可以在Storm搜寻器中存储网页的html内容吗？ - Can i store html content of webpage in storm crawler?
如何使用Web搜寻器遍历许多网站并解析文本 - How to iterate over many websites and parse text using web crawler
如何使用 Storm Crawler 抓取文档（.pdf、.docx 等） - How to Crawl documents (.pdf, .docx etc.) with Storm Crawler
相关标签