Grokking Agentic Design Patterns
Vote

0% completed

​

Tool Granularity, Namespacing, and Dynamic Selection

Suppose each tool definition uses 200 tokens. Desk has 10 tools, so its definitions take 2,000 of the 6,000 tokens in its base. Now suppose the store connects Desk to its warehouse, shipping, billing, and loyalty systems, which adds 110 more tools.

Tools loadedDefinitionsBase per step6-step run
102,0006,00063,000 tokens
12024,00028,000195,000 tokens

The same 6 steps now send about 3 times as many tokens, and the model has 110 more ways to choose wrongly

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%

Vote for new content