How do I union two datasets in Palantir Foundry within a code workbook?

Question

I need to UNION two datasets in a Code Workbook of Palantir Foundry and I'm not sure how to do that. I want to use Pyspark to do this. I'm new to Foundry, please help!

Answer 1

It's the same way you would use PySpark in any other environment!

If you want to union two datasets with the same schema, say datasetA and datasetB , you could do something like

dataset_unioned = datasetA.unionByName(datasetB)

Again, this assumes (and you should probably make sure your data structure abides by this) that your two datasets have the same schema. Checkout the PySpark docs here !