Strange behavior on Production environments only. Bad performance using service endpoint.

(0) Share

Report

Posted on by Yaroslav Korzun

We start facing strange behavior for Production environments. We have a custom class and methods which calculate stocks and prices for products. Running these methods inside Dynamics using web UI shows perfect/expected performance. Same request, same user but using service endpoint (JSON based custom service) shows huge performance difference (2-10 times). Sending multiple times same request we see different response times (twice bigger or lower).

Looks like cache for multi-AOS environments do not work at all or MS changed priority for service endpoint requests. Does someone faced such issue? Any help will be appreciated.

All responses (7)

Answers (0)

André Arnaud de Cal... 291,431 Super User 2024 Season 2 on at

Like (1)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Yaroslav,

If the same codebase and same data is working much faster in UAT compared to the production environment, you can also consider creating a ticket for Microsoft Support.
Yaroslav Korzun 10 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Andre,

Yes, everything looks normal for Production environments, different load per AOS, some low, some average, some high. There is a lot of information due to internal processes and batch works. Digging in logs but I would know what to look for.
André Arnaud de Cal... 291,431 Super User 2024 Season 2 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Yaroslav,

There is some environment monitoring available on LCS. Have you looked at the user activity, raw logs and database activity for possible more information?
Yaroslav Korzun 10 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Will, thanks but link explain how to use UAT for debugging and issue only on multi-AOS env like Prod.
Yaroslav Korzun 10 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Andre,

Ten products in one request. But number of products is no matter. Five products on Prod can take 5-10 sec but on Dev/UAT - 1 sec or less. Ten products on Prod 5-20sec on Dev/UAT - 1-2sec. Difference is significant.

I am also thinking about throttling but our Prod envs not using it, anyway I have set up high priority for used AAD application and user but no luck.
WillWU 22,350 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Yaroslav Korzun,

Please try to debug your production environment to get more details:

docs.microsoft.com/.../dbmovement-scenario-debugdiag
André Arnaud de Cal... 291,431 Super User 2024 Season 2 on at

Like (0)

Report

RE: Strange behavior on Production environments only. Bad performance using service endpoint.

Hi Yaroslav,

Can you provide some more information? Are you communicating the stock and price per item or for all items at once? How many records are included?

Note that there is a priority based throttling for web services: docs.microsoft.com/.../priority-based-throttling