Grokking the Google Forward Deployed Engineer Interview
Vote

0% completed

​

Evaluation, Tracing, and LLM-Native Metrics

MetricBefore the changeAfter the change
Matched the desk on 600 past exceptions528 (88 percent)531 (88.5 percent)
Wrong credit amounts24 (4 percent)24 (4 percent)
Tool calls per exception, median49
Time to first token, median0.9 seconds0.9 seconds
Cost per exception, relative1.001.60

During the build, the FDE changed one line in the shipment check's instructions: "Confirm the latest scan before you answer." The match rate rose by three exceptions

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content