I am syncing about 75 entities down from dynamics 365 using kingswaysoft at an interval every 15 minutes.
I am not using changesets, i am logging each entity into a batch table, by doing the following:
- get last start time.
- use fetch xml query to get latest record where modified by >= last start time.
- upsert to local sql table
then we need to process deletes.
i do this by using a fetchxml to the audit table and getting the deletes.
this SSIS package has grown HUGE ..
every new entity i have to add in needs a new section
every time new fields get added to crm i have to manually add them to the local sql tables and update the package.
it's getting to be a pain to manage.
is there any better way to do this out there? We don't have Azure SQL Databases to sync this too using Microsoft's tool .. so that's out of the question.
Any ideas?