#route53

Route 53 failover not triggering while the primary region was down

Our primary region could not write to its database for 38 minutes, yet Route 53 kept answering with the primary endpoint. The health check was green the whole time. Then automatic failback broke writes a second time. Here is why, and the health check design that fixed both.