Safety and Guardrails

Know the Vocabulary

This lesson uses the terms below many times. Read them once now, and come back here when a later section needs one.

• Large language model (LLM): A model that reads text as tokens and writes text back, one token at a time. A token is a short word or a piece of a longer word.
• Context: All the text the model reads for one request. It holds the instructions, the user's message, and any retrieved documents.
• System prompt: The fixed instructions the team writes for the model. They sit at the start of the context on every request.