Microsoft 365 outage affects approximately 130,000 users, service recovery efforts ongoing

·by Henderson·Engineering
Microsoft 365 outage affects approximately 130,000 users, service recovery efforts ongoing
Key Points
  • The Microsoft 365 outage has affected access for approximately 130,000 users.
  • Server outages and health check issues are the causes of the disruption.
  • Users are experiencing difficulties accessing Outlook and Teams.
  • Microsoft is validating alternative health check methods to restore services.

Microsoft is working to restore services as a widespread outage has impacted access to Outlook, Teams, and other Microsoft 365 applications. According to reports collected by Downdetector, the disruption has affected nearly 130,000 users globally. Microsoft currently believes that unavailable servers and automatic health check issues are the causes of the incident. The company has begun restoring the affected infrastructure. However, as recovery efforts progress, some users are still experiencing connectivity issues.

The server outage that triggered the disruption has been traced by Microsoft to infrastructure issues that caused multiple servers to become unexpectedly unavailable. These outages increased the workload on remaining servers, placing additional strain on the infrastructure. The company stated that the overall increase in traffic was insufficient to explain the rise in load. Instead, the unavailable servers forced the remaining infrastructure to handle more requests than usual. We are actively rebooting and validating the affected servers to bring them back online. Meanwhile, we are assessing whether to roll back a small number of recently identified configuration updates to help expedite recovery.

Causes and Impact of the Outage

Issues with automatic server health checks may have contributed to this outage. These checks help Microsoft determine whether individual servers are operating normally. However, failures in this process evidently prevented certain servers from maintaining availability. The resulting connectivity issues affected several Microsoft 365 products. Users reported difficulties accessing Outlook mailboxes and sending or receiving emails. Other users experienced challenges loading Teams and Microsoft productivity applications. Downdetector recorded nearly 130,000 reports during the peak of the outage, covering applications such as Word, Excel, PowerPoint, SharePoint, and OneDrive.

Microsoft's Copilot assistant also experienced disruptions.

Recovery Measures and Progress

Microsoft has begun validating an alternative health check method to bring the affected servers back online. This method has been effective on some of the impacted devices. The company is now expanding this fix to its affected infrastructure. Microsoft is also developing an automated process to identify unresponsive servers and restart them. The company previously stated that it is rebooting the affected devices to restore availability. At the same time, Microsoft has paused deployments and configuration changes while investigating potential causes. Its investigation has identified that recent configuration updates may be contributing factors.

In its latest update, Microsoft stated that it is actively rebooting and validating the affected servers. The company also confirmed that engineers are assessing whether to roll back certain selected configuration updates to expedite the process. Microsoft has not confirmed whether the configuration changes directly caused the outage, and its investigation is ongoing. Microsoft previously reported progress in restoring Teams services in North America. However, reports from affected users indicate that connectivity issues have not completely disappeared. This outage has also highlighted how failures in individual infrastructure components can impact multiple interconnected services.

Microsoft's cloud applications rely on a vast server infrastructure to handle authentication, communication, and data access. Automatic health checks play a crucial role in maintaining this infrastructure, helping operators identify faulty devices before failures affect broader services. However, issues with the checks themselves can complicate this process. Microsoft's recovery efforts currently involve restoring unavailable servers and examining recent infrastructure changes. The company has not provided a clear explanation for the root cause of the failure. Users experiencing ongoing issues may still encounter intermittent access problems as Microsoft continues its recovery process.

Impact of Server Outages on Cloud Services

This Microsoft 365 outage underscores the critical role of server infrastructure in cloud services. When servers fail to operate normally, it can trigger a chain reaction affecting multiple applications and disrupting users' daily work. The failure of automatic health checks complicates outage issues, preventing timely identification of problematic servers and leading to a wider scope of service interruptions. Microsoft's recovery measures demonstrate the company's commitment to improving its infrastructure; however, this incident also serves as a reminder for the industry to enhance server monitoring and maintenance to prevent similar situations in the future.

H
About the author
Henderson