Grokking LLM Evals
Vote

0% completed

​

Answer Relevance, Completeness, and Unanswerable Questions

The repair guide assistant makes four promises about every answer:

  • It answers the question the technician asked, for the model the technician named.
  • It includes every step and value the documents give for that task, including safety steps.
  • Every claim in it comes from the retrieved documents.
  • When the documents do not hold the answer, it says so instead of guessing.

It also makes three non-promises. It does not diagnose a fault beyond what the documents describe, it does not order parts, and it does not answer questions about customers or billing.

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%

Vote for new content