Technology1 min read

Microsoft identifies months-old bug as root cause of global outage

By · Via The Guardian Business · Published by Everything Blog

In short

The widespread service collapse unfolded after a malfunctioning Teams gateway routed excess traffic to a primary gateway while an unrelated problem had already disabled over 14 percent of server capacity. These combined loads triggered a dormant software flaw that rendered systems unresponsive. Recovery efforts were protracted because returning servers were instantly overwhelmed, preventing typical automated restoration and routine code rollbacks. Microsoft has issued an official apology and committed to releasing a comprehensive final report on the incident.

Key points

  • Microsoft confirmed that the global service disruption was caused by internal system fail…: Microsoft confirmed that the global service disruption was caused by internal system failures rather than a cybersecurity breach.
  • Technicians were unable to use standard rollback procedures to quickly restore service be…: Technicians were unable to use standard rollback procedures to quickly restore service because the underlying bug originated months prior.
  • Automated recovery systems failed because incoming user traffic immediately overloaded se…: Automated recovery systems failed because incoming user traffic immediately overloaded servers each time they were brought back online.

Sources checked by our analysis pipeline: 1

Microsoft has identified the root cause of the outage on Thursday that crippled Outlook, Exchange and a host of other vital office software across the globe.

The company issued an initial report on Monday that identified a months-old bug malfunctioning connections between internal systems as the factors that led to the 24-hour blackout of Microsoft services. Each of these factors may have easily been resolved on their own but, together, led to a major outage that was harder to mitigate, company executives said.

The disruption began Thursday with US users reporting interrupted access to their Outlook email accounts. As it continued into the next day, millions of people worldwide said they could not access their email in any capacity as well as other Office 365 services. Jails could not release prisoners, hospitals turned to paper records, schools lost contact with parents, and police departments could not receive crime reports. Microsoft said it had resolved the issue and restored service by Saturday, also issuing an apology. The company did not attribute the blackout to a cybersecurity breach.

In a post on…

Technology