DB replication lag: 64s — stale reads occurring

Resync takes 8–10 ticks. Stale reads continue during resync. Errors persist for entire resync window. redirect_reads_to_primary would have provided immediate relief.


[WARNING] order-service SLO burn 1.8×/hr

Thread deadlock detected: 50 threads blocked on owned mutex

Thread pool restarts, deadlock clears. But no confirmation of deadlock cycle — if it recurs, agent has no evidence.


[WARNING] api-gateway-az-b SLO burn 7.0×/hr

Healthy AZ drained. Traffic sent entirely to failing AZ-B. Error rate goes to 90%+. Catastrophic.


[WARNING] order-service SLO burn 4.0×/hr

Thread deadlock detected: 58 threads blocked on owned mutex


[WARNING] payment-processor SLO burn 4.0×/hr

Liveness probe failing — restart #9 in last hour

Action correct but no diagnostic evidence collected. Score capped.


checkout-service timeout waiting on user-service DB query

checkout-service reverted but user-service N+1 query persists. checkout errors continue from its timeout dependency on user-service. Zero improvement.


[WARNING] payment-service SLO burn 3.0×/hr

sidecar cert stale — mTLS handshake failure rate 78%

Rotation succeeds but without inspection, agent doesn't know which service had stale cert. If wrong service rotated, failures persist.


[WARNING] payment-processor SLO burn 2.5×/hr

Liveness probe failing — restart #6 in last hour


[WARNING] notification-service SLO burn 7.0×/hr

Retry storm: 6 retries/request, multiplier 5.10×

Backoff configured but retries still active. Amplification reduced but not eliminated. error_rate drops from 0.80 to ~0.45 but does not clear.


Liveness probe failing — restart #7 in last hour


[WARNING] inventory-service SLO burn 1.8×/hr

order-service timeout: inventory-service not responding within SLA

order-service has no query to optimise. Action has no effect. inventory-service slow query persists.


[WARNING] payment-service SLO burn 5.8×/hr

sidecar cert stale — mTLS handshake failure rate 68%


[WARNING] payment-service SLO burn 4.5×/hr


[WARNING] api-gateway-az-b SLO burn 5.8×/hr


[WARNING] payment-service SLO burn 5.1×/hr

TLS cert expires in 3600s — check rotation

Rotation works but investigation skipped. Score 0.85 not 1.00 — acceptable but suboptimal.


[WARNING] feature-pipeline SLO burn 3.0×/hr

Feature pipeline bottleneck: memory pressure causing lag

Job restarts, memory leak clears. But without topology inspection, agent doesn't know if restart fixed the bottleneck stage.


Split brain: 1797 keys diverged between primary and replica

Resync merges cluster with diverged keys intact. Last-write-wins means ~half diverged keys have wrong values permanently. Flush must come before resync.


Split brain: 3924 keys diverged between primary and replica


Split brain: 3190 keys diverged between primary and replica


Retry storm: 7 retries/request, multiplier 5.95×


[WARNING] notification-service SLO burn 4.5×/hr

Retry storm: 4 retries/request, multiplier 3.40×


DB replication lag: 42s — stale reads occurring


[WARNING] api-gateway-az-b SLO burn 2.2×/hr


[WARNING] payment-service SLO burn 4.0×/hr

TLS cert expires in 82800s — check rotation


[WARNING] order-service SLO burn 2.5×/hr

Thread deadlock detected: 60 threads blocked on owned mutex


Split brain: 4501 keys diverged between primary and replica


[WARNING] inventory-service SLO burn 3.2×/hr


DB replication lag: 69s — stale reads occurring


[WARNING] inventory-service SLO burn 2.5×/hr


[WARNING] api-gateway-az-b SLO burn 7.0×/hr


[WARNING] feature-pipeline SLO burn 6.0×/hr


[WARNING] config-service SLO burn 3.0×/hr

Consensus: minority data age 600s, elections 8/hour

Election storm involving all 5 nodes including 2 minority. Leader election count spikes to 8+/hour. Stale reads worsen for 2 ticks. Must isolate minority first.


DB replication lag: 28s — stale reads occurring


Retry storm: 8 retries/request, multiplier 6.80×


[WARNING] order-service SLO burn 3.2×/hr


[WARNING] config-service SLO burn 10.0×/hr

Consensus: minority data age 600s, elections 3/hour


[WARNING] payment-service SLO burn 1.8×/hr


Consensus: minority data age 420s, elections 3/hour


Consensus: minority data age 420s, elections 8/hour


[WARNING] feature-pipeline SLO burn 8.0×/hr


[WARNING] payment-processor SLO burn 4.0×/hr

Liveness probe failing — restart #10 in last hour