web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Microsoft Dynamics 365 | Integration, Dataverse...
Suggested Answer

Synapse Link - Table stuck

(2) ShareShare
ReportReport
Posted on by 8
We have been using Synapse Link for a year now.  We have 2 C=containers where the different tables are being synced to.
Recently for 1 table (reqtrans) the sync seems to have got stuck!
I can see that the csv files are being loaded, but the delta-parquet files are not being updated to reflect the recent changes.
This has happened twice now, on a Friday evening (late), we have not relaised until the Monday morning.
The last time it happened, I ended up having to unlink/relink the table.
This worked for the remainder of the week, but came into work this morning with the same problem.
 
Any help greatly appreciated
I have the same question (0)
  • Suggested answer
    Holly Huffman Profile Picture
    6,530 Super User 2025 Season 2 on at
    Good morning, afternoon, or evening :) depending on your location!
     
    The issue with the reqtrans table sync getting stuck in Synapse Link could be related to change tracking or storage account permissions. Here are steps to troubleshoot:
    1. Verify Change Tracking: Ensure that change tracking is enabled for the reqtrans table in your Dataverse environment. If it’s disabled or misconfigured, the sync process may fail.
    2. Check Storage Account Permissions: Confirm that the Synapse Link service has the necessary permissions to access the storage account. Issues with Managed Identity or access policies can cause sync failures.
    3. Inspect Logs: Review the Synapse Link logs for errors. Look for specific error codes or messages that can provide clues about the root cause.
    4. Monitor Sync Status: Use the Synapse workspace to monitor the sync status of the reqtrans table. Check if the sync process is stuck in a specific phase.
    5. Reconfigure Synapse Link: If unlinking and relinking the table temporarily resolves the issue, consider reconfiguring the Synapse Link profile to ensure stability.
    For more detailed troubleshooting steps, you can refer to the Azure Synapse Link troubleshooting guide or the initial snapshot issues guide.
      
    Hope this helps!
  • JO-07040932-0 Profile Picture
    8 on at
    Thanks Holly  thank you for your response.
     
    1. Change tracking is enabled.  I have a second storage account, and I have pointed the reqtrans table to sync there (as well), this has continued to work since I did this on Monday following the failure of the original reqtrans sync.
    2. There is no issue with storage account; there are other tables syncing there too without issue.  Additionally, when this issue occurred the previous week, I simply unlinked and relinked the table and once it had completed its initial load, syncing commenced as expected.
    3. There is an error reported in the logs!  Rather helpfully it states "Spark jobs are failing due to internal error, please contact support"
    4. I am not sure how to do this.  All I have is the data storage, for the initial delta csvs, and the final parquet folder.  I can also review the overall batch job.  As indicated, I can see that the delta csv;s continue to load, it is the resulting parquet that is not getting updated.  The batch jobs have reported no error.
    5. This is very much a nuclear option!  There are may tables being synced to this location, for which they serve many operational reports.  Reconfiguring the synapse link in its entirety would mean these reports would not be available to the business for several days, which is not acceptable (from the business perspective).

    I had previously reviewed the MS docs you refer to, they did not provide any help.

    Thanks anyway, I very much appreciate your input.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > Microsoft Dynamics 365 | Integration, Dataverse, and general topics

#1
Siv Sagar Profile Picture

Siv Sagar 93 Super User 2025 Season 2

#2
#ManoVerse Profile Picture

#ManoVerse 80

#3
Martin Dráb Profile Picture

Martin Dráb 64 Most Valuable Professional

Last 30 days Overall leaderboard

Product updates

Dynamics 365 release plans