Grokking LLM Evals
0% completed
Key Fact Checklists
A key fact checklist is a list, written from a reference answer, of the facts a good output must contain and the claims it must not make. Each item is small enough to be checked on its own, and each item names who checks it: code, a judge, or a person. The output is graded item by item instead of as one block of text.
A checklist keeps what a reference knows and drops what it does not. A reference summary is one correct wording among many. The facts inside it are what every correct wording must share.
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%