Spark SQL json error

Question

I have tried to create jsonrdd using sql context but getting the below error.. I have placed the code and error below.. please suggest..

My code:

rdd1=sqlContext.jsonRDD('/idn/home/ijamalmo/ibfiles/datafiles/sampledata.json')

Error

Traceback (most recent call last):

File "", line 1, in

File "/opt/mapr/spark/spark-1.4.1/python/pyspark/sql/context.py", line 442, in jsonRDD

 keyed = rdd.mapPartitions(func) 

AttributeError: 'str' object has no attribute 'mapPartitions'

Answer 1

jsonRDD is not a pyspark function. You want:

rdd1 = sqlContext.read.json('fileLoc').rdd