System Design Patterns: From Fundamentals to Real Systems

0% completed

​

LLM Gateway

1. The Incident

Eighteen months of AI enthusiasm, and the store now has fourteen services calling model providers directly: the assistant, search, summarization, three agent experiments, a fraud explainer, and eight things nobody's inventoried. The bills arrive together, as they always do:

  • A key leaks. A provider API key, embedded in a client bundle by a well-meaning team, shows up on a paste site. Rotation means finding every place it's used: fourteen services, three languages, unknown copies: and redeploying each. This is the [API gateway lesson's](

.....

.....

.....

Like the course? Get enrolled and start learning!