The alerts started firing at 9:17 AM on a Tuesday. At a mid-market insurance firm, a new automated claims analysis tool, the CTO’s pet project, was suddenly producing gibberish. For three months, it had been a star, summarizing complex adjuster reports with uncanny accuracy. Now, it was spitting out single, unhelpful sentences. The summaries were technically grammatical but substantively useless.
The engineering team scrambled. They checked their own code. Nothing had changed. They checked the logs, the databases, the network connections. All green. The panic only subsided when a junior developer, scrolling through a forum, saw the chatter. The flagship model from their AI provider had received a "minor alignment and safety update" overnight. The provider’s status page proudly reported 100% uptime.
The service was up. The product was broken.
Companies are building entire features, even entire businesses, on a foundation of sand. We are outsourcing core logic to third-party APIs that provide no meaningful guarantee of behavioral consistency. The traditional Service-Level Agreement (SLA) was built for a deterministic world. It guarantees uptime. It guarantees latency. It guarantees that when you ask the server for a piece of data, you will get that piece of data.
That contract is useless when the server’s job is to think.
The API contract for a large language model is a handshake in the dark. The terms of service are explicit: outputs are not guaranteed to be accurate, complete, or reliable. The providers reserve the right to modify, retrain, and update their models at any time, without notice. What they are selling is not a stable product, but access to a moving target. The SLA ensures the lights stay on in the lab, not that the experiment inside produces the same result twice.
This creates a new and insidious form of vendor lock-in. It’s not about data formats or proprietary protocols anymore. It’s about being locked into the transient, statistical personality of a specific model checkpoint. Migrating a feature from one provider’s
Generated by Reportify AI — Automate your team's status reports, standups, and weekly updates. Try free →