How to create dataset in pyspark
Question
I would like to use dataset in pyspark. I read pyspark doesnt support dataset and only Java / Scala support dataset.
Is there any way I can use Dataset in pyspark?
1 answers
solution1
0 2023-01-10 06:04:33
If you thinking about Typed Spark Datasets, then no, you can't use them in python.
Check this answer .
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Pyspark: how to select a subset of a dataset and save it?
How complex and nested json dataset works with pyspark
How to read .wpd sas dataset in python/pyspark
PySpark: How to create a calculated column in PySpark SQL?
How to create a multiclass dataset?
How to create h5py dataset of a dataset
How to create a kafka stream in PySpark?
How to create a new column in pyspark
How to create a copy of a dataframe in pyspark?
How to create a custom Estimator in PySpark
Related Tags