![](/img/trans.png)
[英]Java Apache Spark Maven Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/SparkConf
[英]java.lang.NoClassDefFoundError: org/apache/spark/SparkConf
我有一個網頁,當我從頁面中選擇一個選項時,它將調用servlet並執行twitter分析查詢。 但是我遇到了異常java.lang.NoClassDefFoundError:org / apache / spark / SparkConf
請在下面找到我的代碼
public static void Top8UsersTweetsCount()
{
SparkConf conf = new SparkConf().setAppName("User mining").setMaster("local[*]");
JavaSparkContext sc = new JavaSparkContext(conf);
JavaSQLContext sqlContext = new JavaSQLContext(sc);
JavaSchemaRDD tweets = sqlContext.jsonFile(pathToFile);
tweets.registerAsTable("tweetTable");
tweets.printSchema();
nbTweetByUser(sqlContext);
sc.stop();
}
private static void nbTweetByUser(JavaSQLContext sqlContext)
{
try
{
FileWriter fw= new FileWriter("C:/Users/ashok/PBPhase2/TwitterAnalysis/WebContent/query2.csv");
JavaSchemaRDD count = sqlContext.sql("SELECT user.name,user.statuses_count AS c FROM tweetTable " +
"ORDER BY c");
List<org.apache.spark.sql.api.java.Row> rows = count.collect();
Collections.reverse(rows);
String rows123=rows.toString();
String[] array = rows123.split("],");
System.out.println(rows123);
fw.append("Name");
fw.append(',');
fw.append("Count");
fw.append("\n");
for(int i = 0; i < 8; i++)
{
if(i==0)
{
fw.append(array[0].substring(2));
fw.append(',');
fw.append("\n");
}
else {
fw.append(array[i].substring(2));
fw.append(',');
fw.append("\n");
}
}
fw.close();
}
catch (Exception exp)
{
}
}
錯誤:
java.lang.NoClassDefFoundError: org/apache/spark/SparkConf
at Query1.UserNamesHavingmorethan600000Friends(Query1.java:447)
at Query1.doPost(Query1.java:82)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:595)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1275)
at [internal classes]
檢查您的項目工件。 如果使用Ant,則必須將Apache-Spark庫添加到容器( Tomcat )工件中。
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.