Service disruption in all regions

Incident Report for SAP LeanIX

Postmortem

Incident Description

On September 1, 2025, we experienced a service disruption that affected customers' ability to access SAP LeanIX.

Customer Impact:

  • Complete SAP LeanIX access disruption for approximately 35 minutes affecting all customers
  • Partial service disruption for some customers lasting up to 24 hours (only affecting the Inventory)
  • No customer data was lost - all data remained secure and intact throughout the incident

System Capabilities Impacted:

  • Complete platform access and navigation
  • Search functionality and bookmark features after the initial outage

Timeline:

  • Disruption Start: September 1, 2025 at 09:15 UTC
  • Peak Impact: September 1, 2025 at 09:27 UTC (complete outage)
  • Initial Resolution: September 1, 2025 at 09:50 UTC (service restored for most customers)
  • Full Resolution: September 1, 2025 at 12:37 UTC (all remaining issues addressed)

Incident Resolution

Our engineering team took immediate action to restore service availability:

Rollback: Within 17 minutes of detecting the issue, we rolled back the recent system deployment that caused the disruption. This restored basic functionality for most customers by 09:50 UTC.

Data Recovery: While no customer data was lost, some customers experienced display issues with their fact sheets due to search index inconsistencies. Our team performed systematic search index rebuilds for affected workspaces to restore normal functionality.

Coordinated Response: We coordinated closely between engineering and support teams to track progress and communicate with affected customers.

Root Cause Analysis

The incident was caused by a compatibility issue with how our system stores and retrieves data for search functionality.

During a system update, changes were made to the data format used by our search infrastructure. However, these changes were not fully compatible with existing data, causing the system to fail when trying to process search requests for Inventory items throughout various parts of the platform.

Preventative Measures

We are developing comprehensive testing procedures specifically for data format changes that affect our search infrastructure. This will include automated compatibility testing against production-like data samples.

Posted Sep 18, 2025 - 08:53 UTC

Resolved

This incident has been resolved. We reverted a software change and are going to refresh the index of those workspaces that had data changed during the time the faulty software version was live.

Some customers might still see a red error message in their workspace when they access a fact sheet that had been altered during the incident. This degradation will be resolved once the automated index refresh process repaired the affected fact sheets. Depending on workspace size this could take several minutes to a few hours.

We appreciate your patience and understanding.
Posted Sep 01, 2025 - 10:19 UTC

Monitoring

We have implemented a fix and have seen full recovery of functionality. We will continue to monitor the situation.
Posted Sep 01, 2025 - 09:51 UTC

Investigating

We are currently experiencing a service disruption in all regions. Workspaces are not accessible, and a red error message is shown (HTTP500). Our team is working to identify the root cause and implement a solution.

We will send an additional update in 60 minutes.
Posted Sep 01, 2025 - 09:35 UTC
This incident affected: AE Instances, AU Instances, BR Instances, CA Instances, CH Instances, DE instances, EU Instances, JP Instances, SG Instances, UK Instances, and US Instances.