简体   繁体   English

Scala / Spark:如何检查数据框是否包含特定的列列表?

[英]Scala/Spark : How to check if a dataframe contains a SPECIFIC list of columns?

How can I test if my DF contains a list of columns? 如何测试我的DF是否包含列列表? I tried this: 我尝试了这个:

finalDF.columns.contains(List("a", "b", "c"))

But I think contains method can only accept one column and not a list. 但是我认为contains方法只能接受一列而不是列表。 Is there any other way to do this? 还有其他方法吗?

Try: 尝试:

List("a", "b", "c").forall(finalDF.columns.contains)

Or: 要么:

List("a", "b", "c").diff(finalDF.columns).isEmpty
val colList = List("col1","col2","col3")

dataFrame.columns.filter(x => colList.contains(x))

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 Scala Spark:如何检查模式数据框是否包含另一个模式 - Scala Spark: How to check if schema dataframe contains another schema 在Spark和Scala中,如何将数据框转换或映射到特定的列信息? - In spark and scala, how to convert or map a dataframe to specific columns info? spark scala 数据框中某些特定列的最大值 - Maximum of some specific columns in a spark scala dataframe 如何使用 Scala 在一个列表中合并多个火花 dataframe 列? - How to merge multiple spark dataframe columns in one list useing Scala? Select 列,其名称包含来自 spark 的特定字符串 scala DataFrame - Select columns whose name contains a specific string from spark scala DataFrame 如何在 Spark Scala 中将列表元素拆分为特定数量的列? - How to split the elements of list into specific number of columns in Spark Scala? 当列未知时,按特定值过滤 Spark Scala Dataframe 中的列 - Filter columns in a Spark Scala Dataframe by a specific value when the columns are unknown 如何在Spark DataFrame,Scala中将行转换为列 - how to convert rows into columns in spark dataframe, scala Spark Scala Dataframe:如何将列转换为行? - Spark Scala Dataframe: How to convert columns into rows? 根据 Spark Scala 中的条件转置 Dataframe 中的特定列和行 - Transpose Specific Columns and Rows in Dataframe based on Condition in Spark Scala
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM