Context Windows

Many people believe that a chatbot remembers the conversation. The belief is reasonable. Give a support chatbot your order number, and ten messages later it still uses that number correctly. It looks like the chatbot remembers what you said, as a person would.

In fact, the model behind the chatbot keeps nothing between calls. On every turn, the application sends the whole conversation again as one block of text, and that block has a size limit. Once a chat gets long, many applications drop the oldest messages, which causes a common bug