I have a use case with a SharePoint library integrated with Dynamics natively, with a high volume of records, and high volume of changes needs to sync to a Dataverse (or other option) table. There are approximately 2M files in the SharePoint library, with several thousand document uploads and changes during the day. We are running into SharePoint API throttling and limits with Flows that are monitoring for creates and modifications to count documents of specific status (custom SharePoint column) in a folder and sub-folders, and write those counts back to the related record in Dataverse.
Ideally, we would have the SharePoint document metadata as a table in Dataverse so that we can more easily query the data, and either create formula columns or plugins to update the related record that the Document is related to. Any suggestions on a means to achieve this?