Grafana Cloud incident: Alerting expressions pipeline failing when recovery settings

Affected components

• AWS Australia - prod-ap-southeast-2: Alertmanager
• AWS Australia - prod-ap-southeast-2: Alertmanager and Rules Configuration API
• AWS Australia - prod-ap-southeast-2: Rule Evaluation
• AWS Brazil - prod-sa-east-1: Alertmanager
• AWS Brazil - prod-sa-east-1: Alertmanager and Rules Configuration API
• AWS Brazil - prod-sa-east-1: Rule Evaluation
• AWS Canada - prod-ca-east-0: Alertmanager
• AWS Canada - prod-ca-east-0: Alertmanager and Rules Configuration API
• AWS Canada - prod-ca-east-0: Rule Evaluation
• AWS Germany - prod-eu-west-2: Alertmanager
• AWS Germany - prod-eu-west-2: Alertmanager and Rules Configuration API
• AWS Germany - prod-eu-west-2: Rule Evaluation
• AWS India - prod-ap-south-1: Alertmanager and Rules Configuration API
• AWS India - prod-ap-south-1: Rule Evaluation
• AWS Ireland - prod-eu-west-6
• AWS Japan - prod-ap-northeast-0: Alertmanager and Rules Configuration API
• AWS Japan - prod-ap-northeast-0: Rule Evaluation
• AWS Singapore - prod-ap-southeast-1: Alertmanager
• AWS Singapore - prod-ap-southeast-1: Alertmanager and Rules Configuration API
• AWS Singapore - prod-ap-southeast-1: Rule Evaluation
• AWS Sweden - prod-eu-north-0: Alertmanager
• AWS Sweden - prod-eu-north-0: Alertmanager and Rules Configuration API
• AWS Sweden - prod-eu-north-0: Rule Evaluation
• AWS Switzerland - prod-eu-central-0
• AWS UAE - prod-me-central-1: Alertmanager

1. resolvedAug 8, 2026, 19:48 UTC

   Due to a software bug the evaluation of some alert rules (primarily ones that have recovery threshold setting) were failing to be evaluated starting 14:00 UTC to 19:30 UTC today.

What APIStatus.watch saw

Our 5-minute checks didn't record a change in Grafana Cloud's overall status around this incident. Smaller or regional incidents often leave a provider's overall status green.

Other services with incidents at the same time

Overlapping incidents aren't necessarily related.

• Elasticsearch: Elasticsearch 9.5.0 contains a query-correctness defectMajor · Aug 5, 2026, 22:59 UTC
• Twilio: SMS Delivery Receipt Delays from Twilio to Liberty Mobile Puerto RicoMinor · Jul 29, 2026, 19:53 UTC
• Twilio: Voice Call Audio Quality Degradation From Network Subscribers to Twilio Colombia Landline NumbersMinor · Aug 6, 2026, 20:09 UTC
• Twilio: SMS Delivery Delays and Failures from Twilio to Multiple Networks in PortugalMinor · Aug 8, 2026, 10:47 UTC
• DigitalOcean: Account Registration, Droplets, and Related ServicesMinor · Aug 8, 2026, 18:57 UTC

How often does Grafana Cloud have incidents?

Grafana Cloud reported 61 incidents in the last 90 days, 22 of them major or critical. A typical incident lasted 2h 24m. See Grafana Cloud's uptime and incident history