Scala on Intellij

Question

When I set up a scala project on intellij I compile and run it locally. I have a line in it as follows

println("Test")

In the output "Test" appears. I believe this is the job's Java System.out. Correct me if i'm wrong. When I run the same scala project (jar) file from intellij, I submit it through intellij (Azure toolkit for intellij) to a spark cluster I have spun up on azure. I do not see the outputs. I do not see "Test" in the window at the bottom.

1. where can i see the outputs?
2. if i can't see the outputs, can i write them to a text file somewhere on blob storage? If so, how?

Answer 1

I'd recommend checking the following documentation , although it specifically mentions remote debugging, there is a section in the screenshots highlighting the console. You could also check the following documentation https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-intellij-tool-debug-remotely-through-ssh

Let me know if this helps.