Setting a sensible maximum caps cost and prevents runaway answers. Each model also has its own hard maximum output, for example 128K tokens on current Claude models.
Frequently asked questions
What does Max tokens mean?
The limit you set on how many tokens a model may generate in one response. Setting a sensible maximum caps cost and prevents runaway answers. Each model also has its own hard maximum output, for example 128K tokens on current Claude models.