DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021 * RESOLVED 1:45 PM CEST *

(3) Share

Report

Posted on by THE Italian

An outage has been declared since 2021-10-26 4:52 AM CEST in NEU Region.

Issue is still ongoing and progress can be tracked here

Iridias - Azure CXP Engineering (microsoft.com)

Below the latest update.

Title: Environment inaccessible

User Impact: Users may be unable to access your environment.

Current Status: After our investigation, we identified that a recent deployment had introduced a code misconfiguration to a portion of the database infrastructure responsible for environment access. We are performing a rollback of the deployment.

Incident Start Time: Tuesday, October 26, 2021, at 2:52 AM UTC

Next Update: Tuesday, October 26, 2021, at 7:30 AM UTC, to allow additional time for the rollback to complete.

UPDATE 1:45 PM CEST

CSS just received from operations that ALL PROD environment in North Europe (NEU) are back online. Still some sandbox environment is getting back online. It might take just few minutes more for these ones.

Below you will find the resolution of the Dynamics 365 Outage item.

Title: Environment inaccessible

User Impact: Users may be unable to access your environment.

Final Status: The rollback has completed. We have verified via telemetry that environment access has been restored.

Incident Start Time: Tuesday, October 26, 2021, at 2:52 AM UTC

Incident End Time: Tuesday, October 26, 2021, at 11:45 UTC

Preliminary Root Cause: A recent deployment had introduced a code misconfiguration to a portion of the database infrastructure responsible for environment access

Next Steps: We're reviewing our standard service update procedures to avoid similar impact in the future.

All responses (8)

Answers (0)

Community Member on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021 *** RESOLVED 1:45 PM CEST ***

Just checked, It's working now.
Community Member on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021 *** RESOLVED 1:45 PM CEST ***

It worked for a while few hours earlier with terrible performance. Now I checked again and both production and sandbox our customer's environment (North Europe) is not accessible with the same "something went wrong" as before:

Something went wrong

Please try again later. If you continue to see this error, provide the information below when requesting support.

TECHNICAL DETAILS

Connection problem

A connection to service could not be established.

Date and Time: 2021-10-26T20:57:40.926Z

What is the current status of this issue? Because for sure it isn't resolved?
THE Italian on at

Like (1)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

Accordingly to operations.

ALL NEU PROD environment should be up and running right now.

Some Sandbox tenant still have to be back online. It might be matter of minutes.

Support Engineer whom is in charge of your request will update you any time soon. Feel free to

a. Open an in-private browser session

b. Login to your Production environment
DFN 5 on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

Latest update I've received (10 min. ago) through email was that the issue is taking longer than expected to resolve.
Chris Maske 35 on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

Any updates for Azure Region Norway East customers?
THE Italian on at

Like (1)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

If you have declared outage through Tenant Admin Center (TAC), a support engineer will provide you an update with a very tight schedule.

This is the current status

Title: Environment inaccessible

User Impact: Users may be unable to access your environment.

Current Status: The rollback is still in progress. We are continuing our telemetry analysis to verify successful completion of the rollback.
Bornerups Soren Nie... 5 on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

Only 10% of ours customers can access their Business Central tenant, and those who can, are having difficulties using it due to timeouts and slow performance, due to infrastructure is drained from ressources :/
MrWho_ on at

Like (0)

Report

RE: DECLARED OUTAGE IN North Europe [NEU] related to Dynamics 365 Business Central 26th October 2021

Norway Region customers still no luck at 11:17 at least. Hopefully available soon?