关于 pyspark 数据帧的时间戳问题

Question

I have a dataframe in which one of the column is a time stamp.

enter image description here

How can i create another data frame from this column in the below format

enter image description here

Can i get some help here please?

Answer 1

Let's say your timestamp column name is time:

from pyspark.sql.functions import * 
df2 = df1.withColumn('year',year('time')).withColumn('quarter',quarter('time')).withColumn('weekOfTheYear',weekofyear('time')).withColumn('dayOfTheWeek', dayofweek('time')).withColumn('dayofmonth',dayofmonth('time'))