Pricing
Input tokens
The tokens you send to a model: instructions, conversation history, documents and images. Billed at the input rate.
In chat apps the whole conversation is re-sent with each message, so input tokens grow as a conversation gets longer. Prompt caching can make repeated input much cheaper.
Frequently asked questions
What does Input tokens mean?
The tokens you send to a model: instructions, conversation history, documents and images. Billed at the input rate. In chat apps the whole conversation is re-sent with each message, so input tokens grow as a conversation gets longer. Prompt caching can make repeated input much cheaper.