Pyspark. How to extract a datetime value from single row dataframe?

Question

I've got a spark dataframe, and trying to get a value for next using.

max_dttm = spark.sql("""select max(issue_dttm) from psycho_sb.yso_sendsay_im_issues""")

It looks like that:

+-------------------+
|    max(issue_dttm)|
+-------------------+
|2018-12-25 09:01:30|
+-------------------+

How i can extract that value in timestamp/datetime format? I want to assign it to a variable.

Answer 1

Something like this :

max_dttm = spark.sql("""select max(issue_dttm) as max_issue_dttm from psycho_sb.yso_sendsay_im_issues""")
max_issue_dttm = max_dttm.collect()[0].max_issue_dttm