Microsoft Dynamics 365 | Integration, Dataverse...

Sudden appearance of "-Analytics" tables in our database

(8) Share

Report

Posted on by Anant K.

Brief overview of the issue:

The table "searchtelemetry-Analytics" (~9GBs) suddenly popped on our database capacity graph earlier this month. Due to that our storage capacity fell down the threshold.
Initially I performed a quick cleanup of other tables emails, tasks, system jobs etc. as I'm unable to find these "-Analytics" anywhere, to bring our storage back to normal while continuing the investigation into these tables.

I found that there have been ~750 new tables having "-Analytics" as the suffix in our production database. These are some of those tables that take up the most amount of storage "searchtelemetry-Analytics", "audit-Analytics", "activityparty-Analytics", "activityparty-Analytics".

After, a lot of back and forth with Microsoft support they shared some information on these tables.

Tables with names ending in “-Analytics” contain data that pertains to predictive insights and/or analytics dashboards.
When an Analytics or Insights feature is enabled in Dynamics 365, these tables are created and the data is synchronized from Dataverse entities into Azure Data Lake Storage based on “-Analytics” tables. The data is then used for generation of analytics or insights. These are Customer Insights/Analytics tables.
They mentioned that the "D365 Sales Insights Add-On" might be responsible for those and turning it off will probably stop the tables from getting populated. I haven't gotten any specific information on that to move ahead with it, also we currently use predictive scoring as well.
Microsoft mentioned to turn off the solutions to remove the data from these “-Analytics” tables but, I'm unable to find those tables/solutions anywhere.

I tried Microsoft's solution found on the help/support page to find the tables mentioned below:

Going through these steps I believe I should those “-Analytics” tables and use this to pin-point the solution and go ahead and turn it off if it's not affecting business operations. But, I don't see these tables in here. I'm not sure if this is how it's supposed to be used, any advice would be appreciated.

My Questions?

My understanding is that there is some analytics/insights feature that got turned on, due to which these tables started storing data. Checking within the team, we're not aware of any feature being turned on around the date this issue started. Also, checked with our analytics team and they don't use these tables either.

Q1. What is that specific functionality or feature that is responsible for these “-Analytics” tables? How do I find it?

Q2. How to access these “-Analytics” tables which are nowhere to be found?

Q3. How to purge the data in these tables? Unable to find them through the D365 bulk delete/advanced find UI or any tools within XrmToolBox.

I would greatly appreciate any advice if someone from the community/Microsoft support know how to tackle this.

Categories:

Dynamics 365 general

Power Platform integration

All responses (8)

Answers (0)

MGR 10 on at

Like (0)

Report

Sudden appearance of "-Analytics" tables in our database

What looks strange to me is, that for us it is consuming File storage and not database storage, even if the docs acticle says "database storage".
Also, I think, this Fabric options have NEVER been activated by us manually. That brings me to the question why should we "pay more" if we haven't "ordered" it and don't need it?

Hope that MS updates its docs article correspondingly.
Anant K. 34 on at

Like (0)

Report

Sudden appearance of "-Analytics" tables in our database

Thanks for trying to find a solution for this @Daivat Vartak (v-9davar), @FH-Inway, @JW-14061318-0 but, I think all those points were to action on how to reduce the storage somehow and were not addressing the root cause.

I think I have found the root cause of this issue. After, a lot of back and forth with Microsoft and trying many different ideas to find the root cause, they provided me a brief explanation.

Microsoft support: "This is due to the use of Fabric Link. Where the customer brings their own Fabric Workspace and exposes their Dataverse org instance to it. It was free until February 4th"

So, this is due to the link to Microsoft fabric in Power Platform Admin Centre:

We had this link to fabric setup a long time back but it is only now that they started charging for it. Which made all the tables to start popping in our Dataverse storage. The "track changes" setting cannot be turned off for tables that are included in this link to fabric. I'm still in contact with Microsoft to find a solution to remove the storage consumed by those tables, I'll keep this thread updated.

Earlier, I looked everywhere and I couldn't find it and I think it's because there is a typo in there. It says "Account-Amalytics" instead of "Account-Analytics" in the documentation.
Link your Dataverse environment to Microsoft Fabric and unlock deep insights - Power Apps | Microsoft Learn
JW-14061318-0 14 on at

Like (0)

Report

Sudden appearance of "-Analytics" tables in our database

Unfortunately Daivat you AI-generated answer simple screenscrapes another blog article that is not relevant, as there is no mnetion of F&O. Also, your post suggests "disabling the feature that's causing it" without saying clearly how to identify that feature. So your response is not helpful in solving this issue.
Suggested answer

Daivat Vartak (v-9d... 5,970 Super User 2025 Season 1 on at

Like (2)

Report
Sudden appearance of "-Analytics" tables in our database

Hello Anant,

You've encountered a complex and frustrating issue with the sudden appearance of "-Analytics" tables in your Dynamics 365 database. Let's break down your questions and provide a comprehensive approach to tackling this problem.

Understanding the "-Analytics" Tables:

As Microsoft support indicated, these tables are indeed related to predictive insights and analytics dashboards. They act as staging areas for data moving between Dataverse and Azure Data Lake Storage. The data is used for generating analytics and insights.

Addressing Your Questions:

Q1. What is that specific functionality or feature that is responsible for these “-Analytics” tables? How do I find it?

D365 Sales Insights Add-On:

Microsoft support is likely correct. The "D365 Sales Insights Add-On" is a primary culprit. It encompasses several features, including predictive scoring, conversation intelligence, and relationship analytics.

Even if your team isn't consciously using all features, some might be enabled by default or through configuration.

Customer Insights:

As stated by support, these are also Customer Insights/Analytics tables. If you have any customer insights features turned on, then these tables will populate.

Finding the Enabled Features:

Sales Insights Settings:

Go to Settings (gear icon) > Sales Insights settings.

Review each section (e.g., Predictive scoring, Conversation intelligence, Relationship analytics) to see if any features are enabled.

Power Platform Admin Center:

Go to the Power Platform admin center and select your environment.

Check the "Features" section to see if any analytics or insights features are enabled.

Solution Layers:

Although you have stated that there are no active solution layers, it is still worth checking. Sometimes settings are changed within a solution, and then that solution is uninstalled, leaving behind changes.

Auditing:

Although this will not tell you what is currently turned on, it may give you an idea of what was turned on in the past. If auditing is turned on, check the auditing logs to see if any insights features were enabled around the time the tables appeared.

Q2. How to access these “-Analytics” tables which are nowhere to be found?

These tables are system tables:

These tables are often hidden from the standard Dynamics 365 UI and advanced find.

They are primarily intended for internal system use

Accessing the Data:

Dataverse Web API:

You can use the Dataverse Web API to query these tables. This requires technical expertise and programming skills.

SQL Queries (On-Premises or Dataverse Direct Access):

If you have on-premises Dynamics 365 or direct access to the Dataverse database, you can use SQL queries to access the data.

Caution: This requires advanced technical skills.

Azure Data Lake Storage:

As the tables synchronize data to Azure Data Lake Storage, you can access the data there. This also requires technical skills

XrmToolBox:

While you mentioned that you could not find the tables with XrmToolBox, try using the "FetchXML Builder" tool. You can use this tool to build fetchXML queries, and then execute those queries against the system tables.

Q3. How to purge the data in these tables? Unable to find them through the D365 bulk delete/advanced find UI or any tools within XrmToolBox.

Disabling the Feature:

The most effective way to prevent further data growth is to disable the feature that's generating the data.

Once the feature is disabled, the tables should stop being populated

Microsoft Support Assistance:

Given the complexity of these system tables, it's best to work closely with Microsoft Support.

They can provide specific guidance on how to safely purge the data.

Bulk Deletion Jobs (Potentially):

While they are hidden, they are still tables. Therefore it is possible that bulk deletion jobs could be used. You will need to use the Dataverse Web API, or SQL queries to find the logical name of these tables. Then you can try to create a bulk deletion job using that logical name

Azure Data Lake Storage Deletion:

If the data is also in Azure Data Lake Storage, you can delete it from there.

Requesting a Data Purge from Microsoft:

If you are unable to delete the data yourself, you may need to request that Microsoft support perform a data purge

Recommendations:

Prioritize Disabling the Feature: Focus on identifying and disabling the feature that's generating the data. This will prevent further data growth.

Work Closely with Microsoft Support: This is a complex issue that requires expert guidance.

Document Everything: Keep a detailed record of all steps taken and communications with Microsoft Support.

Test in a Non-Production Environment: If possible, test any data deletion or feature disabling in a non-production environment first.

If my answer was helpful, please click Like, and if it solved your problem, please mark it as verified to help other community members find more. If you have further questions, please feel free to contact me.

My response was crafted with AI assistance and tailored to provide detailed and actionable guidance for your Microsoft Dynamics 365 query.

Regards,

Daivat Vartak
JW-14061318-0 14 on at

Like (0)

Report

Sudden appearance of "-Analytics" tables in our database

Unfortunately that article doesn't help as it'a few years old and doesn't mention Finance and Operations, and these are F&O table names.
Suggested answer

FH-Inway 4 on at

Like (1)

Report

Sudden appearance of "-Analytics" tables in our database

Maybe this can help?

[Customer Guide] How to Reduce Consumption of "-Analytics" Tables
JW-14061318-0 14 on at

Like (1)

Report

Sudden appearance of "-Analytics" tables in our database

Did you ever make any headway with this? We have the same problem.

Thanks

Jim
Anant K. 34 on at

Like (1)

Report

Sudden appearance of "-Analytics" tables in our database

Recent update from Microsoft support:
To create a power automate flow that turns off the 'Azure Data Lake Storage' sync for the entity "entityanalyticsconfigs". I'm just waiting for them to confirm this as it seems like a hit and trial method, haven't received any solid confirmation or documentation on this.

Meanwhile, my hope is to get some help from the community. If you have any questions, let me know. Thanks!