简体   繁体   English

如何将行从 pyspark 中的 dataframe 转换为列但保留列名? - pyspark 或 python

[英]How can I convert a row from a dataframe in pyspark to a column but keep the column names? - pyspark or python

I have an array where it is made up of several arrays.我有一个数组,它由几个 arrays 组成。

Zip the list and then call the dataframe constructor: Zip 列表,然后调用 dataframe 构造函数:

df = spark.createDataFrame(zip(*all_data), cols)

df.show(truncate=False)
+-----------------------------+-----------+
|name                         |chromossome|
+-----------------------------+-----------+
|NM_019112.4(ABCA7):c.161-2A>T|19p13.3    |
|CCL2, 767C-G                 |17q11.2-q12|
+-----------------------------+-----------+

Or with zip_longest :或者使用zip_longest

from itertools import zip_longest
df = spark.createDataFrame(zip_longest(*all_data,fillvalue=''),cols)
df.show()

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 如何按索引重命名 PySpark 数据框列? (处理重复的列名) - How can I rename a PySpark dataframe column by index? (handle duplicated column names) 如何将pyspark数据帧一行中的字节数组转换为一列字节? - how to convert a bytearray in one row of a pyspark dataframe to a column of bytes? 如何更改 PySpark 中的 dataframe 列名? - How to change dataframe column names in PySpark? 如何创建 pyspark dataframe 按列名称旋转 - How to create pyspark dataframe pivoting by column names 如何在Pyspark的Dictionary中转换Dataframe Column1:Column2(key:value)? - How can I convert Dataframe Column1:Column2 (key:value) in Dictionary in Pyspark? 将 PySpark 数据框列从列表转换为字符串 - Convert PySpark dataframe column from list to string pySpark:如何在 dataframe 的 arrayType 列中获取 structType 中的所有元素名称? - pySpark: How can I get all element names in structType in arrayType column in a dataframe? 如何从数据框中消除行名和列名的值导致pyspark? - How to eliminate row and column name values from the dataframe result in pyspark? 如何将 pyspark dataframe 列转换为 numpy 数组 - How to convert a pyspark dataframe column to numpy array 如何转换 pyspark dataframe 列的值? - How do I convert the value of a pyspark dataframe column?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM