Grokking LLM Evals
Vote

0% completed

​

Retrieval Metrics

0.50, 0.40, 0.33 and 0.39.

Those four numbers describe one list of five chunks, returned for one question: "Which breaker size does the IC-36 induction cooktop need?" Each number comes from a different retrieval metric, and each metric rewards something different. A team that reports only one of them can choose the wrong retriever while every number it reports improves.

This lesson computes four standard metrics by hand on that one list, then in code on two retrievers, and explains which one fits the repair guide assistant.

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content