使用 Spark Java API 进行数据集操作？

Question

I'm new in Spark Java API. I have a Dataset like this:Ds1

|  account|    Lib     |  amount1 |  amount2   |
+---------+------------+----------+-------------
| 222222  |            |          |            |
| 333333  |            |          |            |
| 888888  |            |          |            |
| 888888  | 

I want to get this Dataset:Ds2

|  account|    Lib     |  amount1 |  amount2   |
+---------+------------+----------+-------------
| 222222  |            |          |            |
| 333333  |            |          |            |
| 888888  |            |          |            |

Can someOne please guides me with a Simple expression Using Spark Java API. Thanks in Advance.

Answer 1

Dataset yourDS2 = yourDS1.dropDuplicates();

OR

Dataset yourDS2 = yourDS1.dropDuplicates("account");

Answer 2

请在 ds1 数据集之上使用 dropduplicates 方法