Scala - 连接数据帧关系 1 到 n

Question

I have two dataframes

Dataframe - House(adress, number, zipcode)

adress 1, 28, 04030
adress 2, 01, 25040

Dataframe - People(name, adress, age)

Miki , adress 1, 15
Sterling , adress 2, 20
Archer, adress 2, 25

I need to join both of them into a third dataframe - Filled_HouseHouse(adress, number, zipcode, member1, member2, member3, member4) like

 adress 1, 28, 04030, Miki, null, null, null
 adress 2, 01, 25040, Sterling, Archer, null, null

In Scala+Spark I believe using map and group by could be the answer, but I did not figure the proper way out.

Thanks for your time!

Answer 1

Using

val peopleUnified = people.groupBy("address").agg(collect_list("name")

I got

adress 1, Miki
adress 2, [Sterling, Archer]

So next step is splitting the created list and filling the member fields with the join