Inference
Temperature
A setting that controls how random a model's output is: low values give focused, repeatable answers, high values more varied ones.
Temperature 0 is close to always picking the most likely token. Some recent models no longer accept a temperature setting and are steered through prompting and effort instead.
Frequently asked questions
What does Temperature mean?
A setting that controls how random a model's output is: low values give focused, repeatable answers, high values more varied ones. Temperature 0 is close to always picking the most likely token. Some recent models no longer accept a temperature setting and are steered through prompting and effort instead.