Search for tags unavailable in all regions

Incident Report for SAP LeanIX

Postmortem

Incident Description

On March 9th, 2025, from 12:20 UTC to 13:15 UTC, the functionality of searching for all tags was disrupted across all regions. This issue primarily affected users' ability to list all available tags in the dropdown menu in the Factsheet Details view while trying to add a tag to a Fact Sheet.

Incident Resolution

The issue was discovered early after the deployment, and the change causing the problem was reverted.

Root Cause Analysis

An update to an underlying service for the tag search introduced unintended side effects. The issue was not caught earlier because our automated tests did not account for this specific scenario.

Preventative Measures

  • Test coverage was improved by adding more integrations tests based on this regression, and other Front End inspired scenarios.
  • For such critical changes, we will widen the use of Silent Releases to compare new implementations with current ones. This will more accurately prevent introducing failures, before finally switching to the new implementations.
Posted Apr 11, 2025 - 12:17 UTC

Resolved

From 12:20 UTC to 13:15 UTC, the functionality of searching for tags was disrupted across all regions. This issue primarily affected users' ability to add tags to Fact Sheets on the Fact Sheet details page. The responsible team swiftly identified the root cause and implemented a fix, restoring normal functionality by 13:15 UTC.
Posted Mar 19, 2025 - 12:20 UTC