[英]How to split list of dictionary in one column into two columns in pyspark dataframe?
[英]Is there a way to combine two columns having list values into one column with list value for a pyspark dataframe
假設我有一個 dataframe 如下:
| id |col 1 |col 2
| 1 | ["A","B"] |["C","D"]
| 2 | ["A","B"] |["X","Y"]
| 3 | ["B","D"] |["N","M"]
我需要一個 output 作為:
| id |merged(col1 and col2)
| 1 | ["A","B","C","D"]
| 2 | ["A","B","X","Y"]
| 3 | ["B","D","N","M"]
您可以使用concat
function。
df = df.select('id', F.concat('col1', 'col2').alias('merged(col1 and col2)'))
df.show(truncate=False)
是的,您可以使用 apply -
df['merged'] = df.apply(lambda x: x["col1"] + x["col2"], axis=1)
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.