[英]java.lang.NoClassDefFoundError in spark-submit
I've built the project from https://github.com/tribbloid/spookystuff/tree/branch-0.4 here using 我在这里使用https://github.com/tribbloid/spookystuff/tree/branch-0.4构建了项目
MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m" mvn package -DskipTests=true
MAVEN_OPTS =“-Xmx2g -XX:MaxPermSize = 512M -XX:ReservedCodeCacheSize = 512m” mvn包-DskipTests = true
from here https://gist.github.com/titipata/13fad88df5525d607f24 从这里https://gist.github.com/titipata/13fad88df5525d607f24
Then I'm using a fat-jar created in core/target/x-jar-with-dependencies.jar
in my own separate project. 然后,我在自己的单独项目中使用在
core/target/x-jar-with-dependencies.jar
中创建的胖罐。
<dependency>
<groupId>com.tribbloid.spookystuff</groupId>
<artifactId>spookystuff-core_2.10</artifactId>
<scope>system</scope>
<version>0.4.0-SNAPSHOT</version>
<systemPath>${basedir}/lib/x-jar-with-dependencies.jar</systemPath>
</dependency>
And I'm also creating fat-jar of this project I'm using spookystuff
in ( y-jar-with-dependencies.jar
lets say). 而且,我还在使用
spookystuff
创建这个项目的spookystuff
( y-jar-with-dependencies.jar
可以说)。
Now when running 现在运行时
spark-submit --class org.webcrawler.core.Driver --master local[*] /path/to/my/y-jar-with-dependencies.jar
spark-submit --class org.webcrawler.core.Driver --master local [*] /path/to/my/y-jar-with-dependencies.jar
I get an error stating 我收到一个错误说明
Exception in thread "main" java.lang.NoClassDefFoundError: com/tribbloids/spookystuff/actions/Action
线程“主”中的异常java.lang.NoClassDefFoundError:com / tribbloids / spookystuff / actions / Action
Investigation: 调查:
jar -tvf /path/to/my/x-jar-with-dependencies.jar |
jar -tvf /path/to/my/x-jar-with-dependencies.jar | grep "com/tribbloids/spookystuff/actions/Action"
grep“ com / tribbloids / spookystuff / actions / Action”
I get results but 我得到结果,但是
jar -tvf /path/to/my/y-jar-with-dependencies.jar |
jar -tvf /path/to/my/y-jar-with-dependencies.jar | grep "com/tribbloids/spookystuff/actions/Action"
grep“ com / tribbloids / spookystuff / actions / Action”
I get no classes found. 我找不到任何课程。 Where am I wrong in all this?
这一切我哪里错了?
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.