The scariest line in a Halloween log:
FATAL: sorry, too many clients already
Postgres allows 100 connections by default, 97 for your app. 40 pods × 10 each = 400.
Seen it? What fixed it?
#postgresql#halloween
Wednesday: instant retries turned a slow minute into an outage.
Six rules:
1. Back off exponentially
2. Add jitter
3. Cap retries
4. Respect Retry-After
5. Don't retry 400/401/403
6. Give each client a retry budget
Which one does your client skip?
#sre#backend
Café Wi-Fi. Mobile website. User taps Verify. Silent network check, no SMS.
Your backend gets:
A) true
B) false
C) 403
D) an SMS anyway
#identity#webdev
The database was slow for one minute.
Every failed login retried 5 times, no delay. One login became six requests, load hit 5x, and the database ran out of connections.
The retries made it an outage.
What should the client have done instead?
#sre#backend