Grokking LLM Evals
Vote

0% completed

​

Research Tasks with Known Answers

{
  "id": "parcelhttp-2to3-007",
  "kind": "multi_source",
  "question": "Our service calls parcelhttp with retry=3, streams large files, and runs on Python 3.8. What breaks if we upgrade from 2.9 to 3.0?",
  "from": "2.9.4",
  "to": "3.0.0",
  "snapshot": "102d8e7dfa39",
  "key_facts": [
    {"id": "K1", "fact": "The retry argument was removed; use a Retry object",
     "source": "parcelhttp/changelog#3.0.0", "quote": "Removed: the retry argument."},
    {"id": "K2", "fact": "Requests have a default timeout of 10 seconds",

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%

Vote for new content