2个不同数据框的绑定列引发

Question

I have 2 different data frames in spark and I'd like to bind their columns to form a unique data frame. How can I do it using spark scala?
Thanks

Answer 1

It sounds like you want to join two dataframes.

To do this you need to have a key that you will bind (join) the columns of a row/s with the columns of another row/s on. You can find more information here: https://www.waitingforcode.com/apache-spark-sql/join-types-spark-sql/read

myDataframe
  .join(otherDataframe, col("x") === col("y"))