Hi,
We’re currently facing an issue with Azure Synapse Spark Pools used to generate delta files for consumption by Databricks. This setup supports 11 CRM UAT and 11 CRM PROD environments, each with its own dedicated Spark pool. Everything was working smoothly until a few days ago.
Now, in the Synapse Link configuration, the most recently synced table appears to be from October 5. The top three tables show recent sync activity only because we removed and re-added them during troubleshooting. However, new files aren’t syncing, and the conversion jobs aren’t reaching the Spark pools. The environment is actively in use, and there are changes happening in other tables, but those changes aren’t reflected in the Synapse Link config.
Has anyone encountered a similar issue where Synapse Link stops syncing changes and conversion jobs don’t reach the Spark pool? If so, do you have any suggestions or solutions that helped resolve it?
Furthermore, the last time the Delta conversion job ran in Synapse was also on October 5.
Another interesting thing we’re seeing is that it does seem like some of the records are syncing to the .csv files, but they are in the wrong folders. We see some recent changes going into the “2025-10-05” folder in the data lake. We would expect recent changes to go into a folder with today’s timestamp.
Share
Report
All responses (
Answers (
337
