Pyspark：將SQL邏輯（查詢）轉換為PySpark？

Question

我有一組帶有一些案例陳述的查詢。 我需要在 PySpark 中轉換相同的邏輯。

case when wo_status = 'COMPLETED'  and nvl(resolution,'') not in ('CANCELLING ORDER','CANCEL ORDER','CLOSE SRO')
then 1 else 0 end as completed, --these resolutions indicate cancelled tickets, so even if they come in as closed, call it cancelled
case when wo_status = 'CREATED' then 1 else 0 end as created,
case when wo_status = 'PENDING'  and nvl(resolution,'') not in ('CANCELLING ORDER','CANCEL ORDER','CLOSE SRO') then 1 else 0 end as pending,
case when wo_status = 'CANCELLED'  or ( wo_status in ('COMPLETED','PENDING' ) and nvl(resolution,'') in ('CANCELLING ORDER','CANCEL ORDER','CLOSE SRO') ) then 1 else 0 end as cancelled.

如果有人知道如何在 pyspark 中實現相同的邏輯，將不勝感激。

Answer 1

您可以使用pyspark 文檔中的方法。

your_df = df.withColumn("logic_column", F.when(condition, value).when(...).otherwise(..)