Grokking LLM Evals
Vote

0% completed

​

User Feedback Signals

When a customer taps the thumbs-up button under a reply from the job ticket assistant, what has that customer told you?

The customer has said that the reply felt good to receive. The customer has not said that the trade was right, that the urgency was right, or that the summary invented nothing. A customer cannot see the ticket, and would not know the right trade for a leaking ice maker in any case.

Every signal that users give has a gap of this kind between what it records and what it seems to mean

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content