HDFS URI不完整，不存在主机，Altohugh文件确实存在

Question

i'm trying to access via pyspark to my files in hdfs with the following code:

spark = SparkSession.builder.appName("MongoDBIntegration").getOrCreate()
receipt = spark.read.json("hdfs:///bigdata/2.json")

and i get an error Incomplete HDFS URI, no host: hdfs:///bigdata/2.json

but if i write the command hdfs dfs -cat /bigdata/1.json it does print me my file

Answer 1

The error message says that you have not specified the host in the HDFS URI.

Try to change the URI with:

hdfs://<HDFS_HOST>:<HDFS_PORT>/bigdata/2.json