[英]Reading from Kafka topic using Spark Structured Streaming: Can multi-line JSON published to Kafka topic be parsed by Spark?
Can it be possible to parse/read the multi-line JSON published to Kafka topic by spark using Structured streaming?是否可以使用结构化流通过 spark 解析/读取多行 JSON 发布到 Kafka 主题?
if you are using spark version greater than 2.2, following would work.如果您使用大于 2.2 的 spark 版本,以下将起作用。
spark.read
.option("multiLine", true).option("mode", "PERMISSIVE")
.json("/path/to/user.json")
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.