Incidents

Writeups, newest first.

One page per incident. The format is fixed — timeline, what actually happened, what we are changing — because arguing about format during a writeup is how writeups stop getting done.

• Notifier delivery backlog Action items open2026-08-29 · notifier · Webhook delivery fell behind for eleven hours. Retry ceiling was the proximate cause; the dead-letter path made it invisible.
• Archiver index divergence Closed2026-07-11 · archiver · The what-went-where index disagreed with object storage for a subset of rows moved under the 90-day rule.
• Duplicate runs across a DST boundary Closed2026-06-02 · scheduler · Recurring work scheduled in local time ran twice on the autumn transition and not at all on the spring one.