Inference
Thinking tokens
Tokens a reasoning model generates while working through a problem before its final answer; billed as output.
You may not see all of them, but you pay for them. Lowering the effort level, or disabling thinking where a model allows it, reduces their number on simple tasks.
Frequently asked questions
What does Thinking tokens mean?
Tokens a reasoning model generates while working through a problem before its final answer; billed as output. You may not see all of them, but you pay for them. Lowering the effort level, or disabling thinking where a model allows it, reduces their number on simple tasks.