Environment running low on memory, crashes when memory intensive task is started

(2) Share

Report

Posted on by Jouke Profijt

Hey all,

Currently investigating an issue where a memory intensive task causes a AOS crash. 'OutOfMemory'.

What i am seeing is that the batch-aos is constantly running on low memory, and when the process is started it runs out of memory.

We are aware of the issues with this memory intensive task, and have already taken steps to fix this issue. But for now the fix has not been released.

What i'am cuirious about is where is all the memory of the BatchAOS going before the task is started. Is there any way to retrieve this information? Cant seem to pinpoint a single activity in LCS. (bear in mind in quite new to the LCS monitoring)

See the task is started at 7:38:00 and causes a crash at 7:44:00. But before starting the available memory is already low.

A few hours later(12:49), the memory has decreased some, but not nearly as low as 1300Mb:

Any way i can investigate further?

Thanks!

Categories:

Dynamics 365 Finance

I have the same question (0)

All responses (2)

Answers (0)

Jonas "Jones" Melgaard 4,986 Most Valuable Professional on at

Like (2)

Report

No, it's not possible to see exactly what is consuming memory or causing a memory leak in Microsoft hosted environments. My advice is to contact Microsoft Support and check whether this is a known issue or if something can be scaled.

However, if you want to dig a bit deeper, you can take a look at this article: https://denistrunin.com/performance-powerbibatch/

I built a dashboard similar to Denis’s at my former job to debug AOS Batch memory consumption. Maybe you can correlate the memory consumption with the batch schedule. Notice his "Batch tasks schedule" example.

Was this reply helpful? Yes No
Jouke Profijt 14 on at

Like (1)

Report

So, status update.

While not certain that the issue has been resolved, Microsoft support had given us information about running batch tasks which were taking up the most time/resources.

We've reorganized these batches to run at different times, as these seemed to have a conflict in the tables which were in use.

We also updated the batch-priority as all batches were running on low priority. Now most jobs run as normal priority, our problematic task which is quite important for the customer has been assigned reserved capacity.

After this change the task has successfully run 3 times for a larger set.

Only thing that we see now is that the BatchAOS's seem to restart every morning and the available memory still seems to decrease throughout the day:

This might be normal behaviour? i'm not sure.

Was this reply helpful? Yes No

Join the conversation

Community site session details

Environment running low on memory, crashes when memory intensive task is started

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates

Community site session details

Environment running low on memory, crashes when memory intensive task is started

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Subscribe to this forum!

Select categories

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates