简体   繁体   中英

Read file parquet file from s3 in java

I am new to Java & spark sql. I wanted to know if there is a way to read a file of type Spark Parquet format saved as JSON in S3 in my Java code?


val spark = SparkSession.builder()
      .master("local[1]")
      .getOrCreate()

spark.read().json("s3a://your/json/path.json")

spark.write().parquet("parquet/file/path.parquet")

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM