Chapter Assessment: Evaluation and Observability Patterns

This assessment covers Evaluation and Observability Patterns. Its bank holds 27 questions, and each attempt draws ten, so taking it again tests different material. The questions favor judgment over recall. Most describe a trial of Desk or another agent and ask which grader fits, what a trace reveals, or what the team should do next. Several ask you to work out a number. Keep three points ready. pass^k is calculated per task and requires every trial to succeed, while pass@k needs only one. A state check reads the environment, so the wording of a reply cannot fool it