Tokens

Tokens are the units into which an AI divides text for processing. A single token is roughly four characters, but this can include spaces.

For the purposes of Red Quill, all that matters is that there is a maximum total of tokens, called the "context". A simple way to think about that context is to imagine the storage on a phone. You can fill it up with pictures, but then when you try to download movies or songs, there won't be any room. If you download several movies, you might not have room for many pictures.

The context has to be divided between the packaging that RQ uses for the prompts, plus all the users components, plus the prompt plus the reply. Therefore, if there are many components and a very large prompt, there is less room for the reply. In practice, the context is likely large enough to handle many components and large prompts, but like everything there is going to be a limit.