Skip to main content

Notifications

Announcements

No record found.

Small and medium business | Business Central, N...
Unanswered

[DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

Posted on by

LAST UPDATE: RESOLVED

WORLDWIDE issue

Title: Users may have been unable to sign into your environment

User Impact: Users may have been unable to sign into your environment.

More info: Users may have received the following error when attempting to sign in: “Your account has been authenticated with Azure Active Directory, but there is no valid license assigned to your account in Business Central. Contact your system administrator to get a valid license.”

Final Status: We determined that the recent service update contained a code misconfiguration, which resulted in high resource utilization within the impacted portion of the infrastructure. We performed a rollback of the misconfigured code to the previous healthy configuration. We have confirmed via telemetry analysis and testing that users access to their environment has been restored.

Incident Start Time: Thursday, November 18, 2021, at 12:48 PM UTC

Incident End Time: Thursday, November 18, 2021, 2021, at 11:08 PM UTC

Preliminary Root Cause: A recent service update contained a code misconfiguration which resulted in impact.

Next Steps: We're reviewing our update procedures to better identify similar issues during our development and testing cycles.

Total Downtime:  10h 20m 

Update 6 - 11:12 PM CET

Operations is continuing to monitor service health as the recovery progresses.

Update 5 - 7:22 PM CET

Partner should be able to see outage enlisted in Partner Center https://portal.office.com/Adminportal/Home#/servicehealth

 

Update 4 - 6:00 PM CET

After operations investigation, it has been currently identified high resource utilization in a portion of the infrastructure responsible for environment authentication as a result of a recent service update, resulting in impact. Operation telemetry analysis has determined that service health recovery is ongoing, and operations is investigating way to expedite its recovery.

In shorts, all clusters worldwide are slowly recovering and if not already done, it might take some time to have this back up and running.

It has been noticed tenant restart from few minutes up to few hours. Everything depends upon the load on every single cluster and it is not so linear, unfortunately.

Operations suggested a policy of wait and observe. It might be feasible that this might be potentially resolved in the next hours.

 

Update 3 - 4:50 PM CET

Operations seems to correlate the root cause internally and seems quite close to find out the root cause.

Still it is not confirmed yet. 

Update 2 - 4:24 PM CET

Outage spread all over the world and officially declared impacting worldwide. 

Operations still investigating root cause how and why this is happening with all workforces.

Update 1 - 4:00 PM CET

Operations is still checking for root cause and trying to have customers up and running as soon as possible

  • Navneet Narang Profile Picture
    Navneet Narang 10 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    Same here. I (customer) told our vendor that BC is down. It took me an hour to realize that the issue is at MSFT side. For 45 minutes we faced the issue of user authentication (which was weird).

  • Navneet Narang Profile Picture
    Navneet Narang 10 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    INDIA.

    Horrible outage. Businesses impacted very badly. Even After 15 hours services are not fast.

  • dhubbell Profile Picture
    dhubbell 10 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    Southern California,

    Seen a noticeable improvement, but service spikes with UP and down times which include S L O W I N G.

    Biggest concern is what will this outage leave in the wake?  Missing Data? 

  • RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    We've been down in New Zealand all morning also.

    Limited to Production environments initially but has now extended to Sandbox environments as at 9:30am NZT. All clients affected.  

  • Indira88 Profile Picture
    Indira88 889 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    BC is up and running.

  • MahGah Profile Picture
    MahGah 15,428 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    It is down again in USA 

  • Hellhound105 Profile Picture
    Hellhound105 5 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    Same as when Azure VMs could not be started. 4 hours for MS to wake up and acknowledge the issue.

    Yet the same happened here again.

  • phkGZ Profile Picture
    phkGZ 40 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    I'd like to know the same Rick. Having to resort to downdetector, twitter, reddit & this site to piece together information is not good enough for business critical apps such as BC. There should be a mailing list you can sign up for at the slightest hint of issues.

    I should be telling the users there is an issue, not the other way around.

  • Rick Harink Profile Picture
    Rick Harink 10 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    We are having the same problem here in the Netherlands (West Europe). At around 16:00 CET Business Central was not available for our team. Is there any official page where to find more information about this outage?

  • BM Andover Profile Picture
    BM Andover 30 on at
    RE: [DYNAMICS 365 BUSINESS CENTRAL OUTAGE] Impacted North Europe and others

    Ours is running again, but we'll see if it lasts this time.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Suggested Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,280 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,235 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans