LLM Gateway

1. The Incident

Eighteen months of AI enthusiasm, and the store now has fourteen services calling model providers directly. There is the assistant, search, summarization, three agent experiments, a fraud explainer, and eight things nobody has inventoried. The bills arrive together, as they always do.

A key leaks. A well-meaning team embedded a provider API key in a client bundle. It shows up on a paste site. Rotation means finding every place it is used: fourteen services, three languages, unknown copies. Then each one must be redeployed