The RAG Pipeline

The Request Path, End to End

Ingestion made the documents searchable. This lesson follows a question through the request path.

Organize the request path into five stages so each can be tested and monitored separately.

Each stage fails in its own way, gets tuned in its own way, and gets evaluated in its own way.

"Where in the pipeline is this failure?" is the question production engineers ask every day. It is also what the interview deep-dive is really testing.

Query Processing: The Stage Everyone Forgets

Raw user queries are difficult for retrieval. They fail in two standard ways.