Pyspark: how to get Date from Weeknumber and Year

Question

I have a dataframe with a column containing week number and year. For example: 18/2020 , which corresponds to the first date of 2020-04-27 . How can I extract the complete date column?

Answer 1

Simply use to_date with the format w/yyyy :

df = spark.createDataFrame([(1, "18/2020")], ['id', 'week_year'])
df.withColumn("date", to_date(col("week_year"), "w/yyyy")).show()

#+---+---------+----------+
#| id|week_year|      date|
#+---+---------+----------+
#|  1|  18/2020|2020-04-26|
#+---+---------+----------+