Grading Claims, Citations, and Coverage

A claim is one statement in an answer that can be right or wrong on its own, such as "The retry argument was removed in 3.0." An answer from the upgrade research agent holds several claims, each with its own citation. One answer can contain five correct claims and one that sends an engineer to rewrite code that never needed changing.

A single grade for the whole answer would hide which claim failed and why. The research agent is therefore graded claim by claim, with four separate measures: claim support, citation accuracy, key fact coverage, and stale information.