Design a ChatGPT-Style Assistant

Know the Vocabulary

This lesson uses the terms below many times. Read them once now, and come back here when a later section needs one.

• Chat assistant: A product where a user writes messages and a model writes replies. One conversation can go on for many turns.
• Turn: One user message and the assistant's reply to it.
• Send: One message that a user sends. Each send starts one model call.
• Token: The unit of text a model reads and writes. One token is about three quarters of an English word.
• Stateless: Keeping no memory between calls