Grokking LLM Evals
Vote

0% completed

​

The Help Center Test Set

DIMS = {
    "topic": ["pay runs", "taxes and filings", "employees",
              "time off", "benefits", "integrations"],
    "style": ["keywords", "full question", "pasted error"],
    "plan": ["Standard", "Advanced"],
    "answer": ["one article", "two articles", "not covered"],
}
# one tuple: ("taxes and filings", "pasted error", "Standard", "not covered")

Each key above is one way in which help center questions differ, and each list holds its values. Choosing one value from every list gives a tuple, such as the one in the comment

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%

Vote for new content