Reading from Kafka topic using Spark Structured Streaming: Can multi-line JSON published to Kafka topic be parsed by Spark?

Question

Can it be possible to parse/read the multi-line JSON published to Kafka topic by spark using Structured streaming?

Answer 1

if you are using spark version greater than 2.2, following would work.

 spark.read
  .option("multiLine", true).option("mode", "PERMISSIVE")
  .json("/path/to/user.json")