Dynamics Community Forum Thread Details

Azure Synapse Link - Synchronisation issues with accountid in contact-table

As a Proof Of Concept, I have configured two synchronisations from Dynamics 365 to Azure SQL, to be able to run Power BI dashboards. (Since the direct connection with Dynamics 365 gives timeouts since several weeks):

* Using Azure Synapse Link in make.powerapps:

- Blackbox synhronisation of csv-files in an Azure Storage Account

- Azure Data Factory pipeline to sync csv-files to Azure SQL database

* Using Azure Synapse Studio

- Connect to Dynamics 365 and with several pipelines create parquet-files in an Azure Storage Account

- Create views in a serverless SQL Pool that make the parquet-files available for queries

It doesn't work 100% in both cases. :-)

An extreme annoying issue in both scenario's is the "accountid"-column that is empty in the "contact"-table.

We have 311.414 records in contact and 212.917 records have an account linked. For the other 98.497 records, the accountid is NULL.

But immediately after syncing (so in the csv and parquet-files), the accountid is NULL for all records.

Does anyone has an idea on how to solve this?

I assume the connector "sees" the first records and assumes the column is always NULL?

* Can I configure something in the Azure Synapse Link?

* Can I configure something in the Dynamics 365 connector in Synapse? Maybe in the "Parameters"- or "Advanced"-section?

* Can I configure something in Power Apps for that specific table and column?

Thanks for your responses,

Tim

Categories:

Dynamics 365 general

It sounds like you're facing a challenging issue with the synchronization of the accountid column in the contact table. Here are some steps you can take to troubleshoot and potentially resolve this issue:

Azure Synapse Link Configuration:
- Ensure that the Track Changes property is enabled for the contact table in Dataverse. This setting is crucial for incremental data synchronization.
- Verify that the accountid column is included in the schema and is not being excluded during the synchronization process.
Dynamics 365 Connector in Synapse:
- Check the connector settings in Azure Synapse Studio. In the Parameters or Advanced section, ensure that the accountid column is correctly mapped and included in the data flow.
- Review the initial snapshot configuration to ensure that all columns, including accountid, are being captured correctly.
Power Apps Configuration:
- In Power Apps, navigate to the contact table and verify the column settings for accountid. Ensure that the column is set up correctly and is not hidden or excluded from synchronization.
- You can also create a custom view or query in Power Apps to ensure that the accountid column is populated correctly before synchronization.
Data Factory Pipeline:
- In your Azure Data Factory pipeline, review the copy activity settings to ensure that the accountid column is being copied correctly from the source to the destination.
- Check for any transformations or filters that might be affecting the accountid column during the data flow.
Troubleshooting Guides:
- Refer to the for common issues and resolutions.
- Review the to ensure that the initial data load is configured correctly.

By following these steps, you should be able to identify and resolve the issue with the accountid column synchronization. If you need further assistance, feel free to ask!

Quick Links