简体繁体 English

Apache Nutject注入网址

[英]Apache nutch inject urls

原文 2017-11-26 16:03:12 0 1 mongodb/ apache/ solr/ ubuntu-16.04/ nutch

I am new to Apache Nutch(2.3.1) and mongodb(3.4.7). 我是Apache Nutch（2.3.1）和mongodb（3.4.7）的新手。 After instalation steps I want to inject urls and crawl wikipedia website. 安装步骤后，我想注入URL并爬网Wikipedia网站。 when I run "./nutch inject urls" in terminal I faced to this error. 当我在终端中运行“ ./nutch注入URL”时，我遇到了这个错误。

~/apache-nutch-2.3.1/runtime/local/bin$ ./nutch inject urls InjectorJob: starting at 2017-11-26 19:07:35 InjectorJob: Injecting urlDir: urls InjectorJob: org.apache.gora.util.GoraException: java.lang.NullPointerException at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:167) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135) at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:78) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:218) at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284) Caused by: java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) at java.util.concurrent.ConcurrentHashMap.containsKey(ConcurrentHashMap.java:964) at org.apache.gora.mongodb.store.MongoStore.getDB(MongoStore.java:192) at org.apache.gora.mongodb.store.MongoStore.initialize(MongoStore.java:122) at org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161) ... 7 more

1 个解决方案

Actually I had set wrong Mongo database'name in $NUTCH_HOME/conf/gora.properties file. 实际上，我在$ NUTCH_HOME / conf / gora.properties文件中设置了错误的Mongo数据库名称。 After fix it , Apache nutch work correctly. 修复后，Apache螺母可以正常工作。