web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Customer experience | Sales, Customer Insights,...
Suggested Answer

Dynamics Tables With Large Number Of Rows

(0) ShareShare
ReportReport
Posted on by 142

My organisation has a need to hold a dataset with ~ 39 million rows in it. There are ~40 characters per line.

Is Dataverse a good place to keep this amount of data? Or should I be looking at some other service?

I have the same question (0)
  • Suggested answer
    Wahaj Rashid Profile Picture
    11,321 on at

    Hi,

    Thank you for your query.

    What is the purpose of this data? Do you need to do any transactions on this data or is this for reporting purposes? Also, do you need to create relationships with this table?

    In my opinion, if this data is not being used in a Dataverse transaction, I will not store it in Datavsers for the following reasons:

    • The cost of storage will increase, I would recommend doing math on how many GBs you would require. For your reference, one of my clients has around 15mil of records in the Activity table and the table size on disk is around 700GB (luckily it's on-prem).
    • Datsaverse tables have other metadata fields (like Created On, Modified By), which will increase the size of this table (when records are 39 million it matters).
    • If the table is created with user ownership, it will have relationships with User and Team entities, which might impact the performance.
    • Dataverse create filtered views on top of tables, which are costly, especially when the number of records is 39m.

    Depending on the need, I will either store this data in Azure Datawarehouse, Azure Blob storage, or a Datalake. Then I will build controls or reports to user/show this data on-demand in the dataverse.

  • Suggested answer
    meelamri Profile Picture
    13,216 User Group Leader on at

    To complete Wahaj's answer. Your Dataset can be kept in an Azure DB, and use the virtual entities on Dataverse to manipulate them. Indeed, virtual entities support all CRUD operations.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > Customer experience | Sales, Customer Insights, CRM

#1
Tom_Gioielli Profile Picture

Tom_Gioielli 170 Super User 2025 Season 2

#2
#ManoVerse Profile Picture

#ManoVerse 61

#3
Gerardo Rentería García Profile Picture

Gerardo Rentería Ga... 52 Most Valuable Professional

Last 30 days Overall leaderboard

Product updates

Dynamics 365 release plans