Grokking LLM Evals
0% completed
Monitoring the Help Center Bot
Suppose the tax agency moves one quarter's payroll filing deadline. On a Monday morning, the support team updates the help article that states the deadline. The article index, however, is rebuilt only on Sunday nights, so the bot keeps retrieving chunks from the old version of the article.
For the rest of the week, administrators who ask "When is the quarterly filing deadline?" get the old date, with a link to the updated article. About 300 of them ask each day. Some notice that the link and the answer disagree, and they contact support. Others file on the old date.
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%