Spark MLLIB questions
Question
I am looking into the source code of Spark-mllib, and I noticed all the source code are in scala, not java.
Wouldn't scala in general use more resources than Java? Why the ML engine here is written in scala, not Java? Am I missing anything here?
Also, Eclipse Luna seems to have trouble coordinate with the latest version of scala? Which IDE would people recommend for build the spark code with scala modules?
Thank you very much!
1 answers
solution1
0 2015-06-17 10:18:22
- The source code are in scala, java and python at most places in the latest Spark version(1.4). ( https://spark.apache.org/docs/latest/index.html )
- I recommend you to use the IntelliJ IDEA . According most people's experience, it is most intelligent IDE for scala development.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Parallelism in spark.mllib
Scala Spark MLLib NoClassDefFoundError
spark mllib predict error with map
Loading Mllib models outside Spark
Scala Spark - using RDD with mllib
Naive Bayes with Apache Spark MLlib
Java heap space in spark mllib
not able to import spark mllib in IntelliJ
Spark import of the mllib package member
Spark mllib Classification using scala
Related Tags