Qubole Kinesis Connector for Spark structured streaming throws an error
Question
We are using Qubole Kinesis Connector (jar) for Spark structured streaming. This used to work fine but suddenly, it is throwing an error "S3 filesystem not found".
We could use the KCL but we need to test it for foreachbatch. Are there any other available Kinesis connectors available that provide seamless writing operations?
1 answers
solution1
0 2020-02-17 06:16:06
@Lightning-Analytics, Please share the full stack trace and respective qubole streaming command-id if any.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Spark Structured Streaming Kinesis Data source
Spark Structured Streaming watermark error
Spark Streaming - Error when reading from Kinesis
Spark Streaming - Kinesis - Java
Spark Structured Streaming: path not specified error
Error connecting to Zookeeper with Spark Streaming Structured
Error when connecting spark structured streaming + kafka
Spark Kinesis Streaming example
Spark Structured Streaming Kafka error -- offset was changed
Error when using mapGroupsWithState in Spark Structured Streaming
Related Tags