Grokking Generative AI Fundamentals
0% completed
Choosing a Model
| Model | Cost per month | Seconds per summary | Correct on 50 test tickets |
|---|---|---|---|
| Small | $84 | 1.4 | 82% |
| Medium | $720 | 2.9 | 90% |
| Large | $2,700 | 5.8 | 94% |
A support team wants a model that summarizes long tickets for its agents. The table compares three model sizes on that job, at about 200,000 tickets a month. All of its numbers are illustrative.
No row is best in every column. The large model is the most accurate, but it is also the slowest, and it costs about 32 times as much as the small one
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%