Spark grouped Dataframe details
Question
How can I achieve keys of a grouped spark-dataframe ?
And another question:
What does a pyspark.sql.group.GroupedData object include?
1 answers
solution1
0 ACCPTED 2018-05-12 09:04:38
How can I achieve keys of a grouped spark-dataframe?
Without aggregating data and collecting the result it is not possible. It would be easier to just:
df.select(grouping_columns).distinct()
What does a pyspark.sql.group.GroupedData object include?
Just the execution plan:
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Loop through each row in a grouped spark dataframe and parse to functions
Removing rows in a nested struct in a spark dataframe using PySpark (details in text)
Removing columns in a nested struct in a spark dataframe using PySpark (details in text)
Grouped linear regression in Spark
plot the mean of grouped dataframe
Seaborn swarmplot of grouped dataframe
Filtering grouped DataFrame in Pandas
Plotting a grouped pandas dataframe
Split dataframe into grouped chunks
If statement in grouped Pandas dataframe
Related Tags