Tag
2 articles
Tags cut across the blog’s categories: the articles below approach reliability from whichever angle their subject demanded — a pricing breakdown, a benchmark reading, a migration note, or a postmortem from running something in production. They are ordered newest first, so the top of the list reflects where our current thinking sits rather than where it started.
Most fallback configurations are written once, never exercised, and quietly wrong. Provider outages are a when, not an if. Here is how to design a chain that degrades gracefully instead of failing over into a wall.
First-token latency is what users perceive, so streaming isn't optional. But every provider streams differently, and a mid-stream failure surfaces to your app as a truncated response. Here is what normalising the stream at the gateway actually buys you.
Articles tagged “reliability” also carry the tags below. They are ranked by how often they appear alongside this one, so the first few are the closest neighbours to what you are already reading.