pyspark：Configparser 未从谷歌存储读取配置文件

Question

I am trying to read a config file from google storage bucket via pyspark script run by dataproc. But the file is not read.

config = configparser.ConfigParser()
config.read('gs://<<google_bucket_location>>/example.ini')
[]

Answer 1

Notice that configparser reads only local files. The best option is to download the config file from GCS into a tmp directory and read it form there.