AZ synapse linked Dataverse tables disappearing in AZ data lake Gen2

Question

I have synced my dataverse tables to az Data lake using azure synapse link. I verified that tables did appear. some time later when I checked, no tables were there. Not sure why. Need help. Tables in Dataverse synapse link store

Az Data lake showing no tables

Answer 1

In some cases, a newly linked won't be immediately available. Wait a few moments, and it should become available.

Ensure that you followed the prerequisites of creating and configuring the Azure data lake storage account, and granting yourself an owner role on the storage account. Additionally, you grant the Power Platform Dataflows service access to your storage account. More information: Self-service data prep with dataflows .

Your Dataverse environment is linked to the Azure Data Lake Storage Gen2 account. The file system in the Azure storage account is created with a folder for each table selected to be replicated to the data lake.

While viewing your data in Azure Data Lake Storage Gen2, ensure to select the below from file systems correctly as per your setup.

dataverse-environmentName-organizationUniqueName

Additionally you can validate using the model.json file, along with its name and version, provides a list of tables that have been exported to the data lake. The model.json file also includes the initial sync status and sync completion time. A folder that includes snapshot comma-delimited (CSV format) files is displayed for each table exported to the data lake.

Microsoft Dataverse data can continuously change through create, update, and delete transactions. Snapshots provide a read-only copy of data that's updated at regular intervals, in this case every hour to ensures that at any given point, a data analytics consumer can reliably consume data in the lake.

Opening model.json, you can view the snapshot details. Changes in Dataverse are continuously pushed to the corresponding CSV files by using the trickle feed engine.