java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z
[英]java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z
问题描述
I want to show spark dataframe and I used:
我想显示火花数据框，我使用了：
df.writeStream.outputMode("append").start().awaitTermination()
But when I got the error when run this line:但是当我在运行这一行时遇到错误时：
21/07/16 01:20:53 ERROR MicroBatchExecution: Query [id = f243e6e6-c02e-4e70-b5c3-6a821fd33232, runId = 312544cf-fea8-45b4-94a1-c052306538cf] terminated with error
java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z
1 个解决方案
解决方案1
3 2021-08-15 18:26:43
Check the version of spark and version of dependencies you have added.检查您添加的 spark 版本和依赖项版本。 Make sure both are having the same versions.确保两者具有相同的版本。 This will resolve the issue.这将解决问题。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
Apache Spark：java.lang.NoSuchMethodError .rddToPairRDDFunctions - Apache Spark: java.lang.NoSuchMethodError .rddToPairRDDFunctions
Spark 1.3.1 SQL Lib：线程“ main”中的异常java.lang.NoSuchMethodError：org.apache.spark.sql.SQLContext.implicits（） - Spark 1.3.1 SQL Lib: Exception in thread “main” java.lang.NoSuchMethodError: org.apache.spark.sql.SQLContext.implicits()
无法运行火花壳！ java.lang.NoSuchMethodError：org.apache.spark.repl.SparkILoop.mumly - Can't run spark shell ! java.lang.NoSuchMethodError: org.apache.spark.repl.SparkILoop.mumly
使用java.lang.NoSuchMethodError火花读取HBase：org.apache.hadoop.mapreduce.InputSplit.getLocationInfo错误 - Spark Read HBase with java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.InputSplit.getLocationInfo error
Amazon Deequ (Spark + Scala) - java.lang.NoSuchMethodError: 'scala.Option org.apache.spark.sql.catalyst.expressions.aggregate.AggregateFunction.toAgg - Amazon Deequ (Spark + Scala ) - java.lang.NoSuchMethodError: 'scala.Option org.apache.spark.sql.catalyst.expressions.aggregate.AggregateFunction.toAgg
Apache Spark - java.lang.NoSuchMethodError：breeze.linalg.DenseVector - Apache Spark - java.lang.NoSuchMethodError: breeze.linalg.DenseVector
flink scala 流错误 java.lang.NoSuchMethodError: org.apache.flink.util.PropertiesUtil.getBoolean(Ljava/util/Properties;Ljava/lang/String;Z)Z - flink scala streaming error java.lang.NoSuchMethodError: org.apache.flink.util.PropertiesUtil.getBoolean(Ljava/util/Properties;Ljava/lang/String;Z)Z
Spark SQL toDF方法因java.lang.NoSuchMethodError而失败 - Spark SQL toDF method fails with java.lang.NoSuchMethodError
java.lang.NoSuchMethodError Jackson 数据绑定和 Spark - java.lang.NoSuchMethodError Jackson databind and Spark
火花提交中的 java.lang.NoSuchMethodError - java.lang.NoSuchMethodError in spark-submit
相关标签