English Français العربية

AI glossary

146 terms explained plainly, in English, French and Arabic.

  • 11 topics
  • English, French and Arabic

15 terms

A

Inference API key A secret string that identifies your account when calling a provider's API; whoever holds it can spend your credit.

D

Inference Data residency Keeping data processing within a specific region, such as the EU or US, often required by law or contract.

E

Inference Effort (reasoning effort) A setting on reasoning models that controls how much they think before answering, trading cost and speed for quality.

L

Inference Long-context pricing Higher per-token rates some providers charge when a single request exceeds a size threshold.

M

Inference Max tokens The limit you set on how many tokens a model may generate in one response.

O

Inference On-device (edge) AI Running models directly on phones, laptops or other devices rather than in the cloud.

R

Inference Rate limit The cap a provider sets on how many requests or tokens you can use per minute or per day.

S

Inference Sampling How a model picks each next token from its predicted probabilities, rather than always taking the single most likely one. Inference Self-hosting Running an open-weight model on your own servers or cloud instances instead of calling a provider's API. Inference Streaming Sending a model's output to the user token by token as it is generated, instead of waiting for the full answer.

T

Inference Temperature A setting that controls how random a model's output is: low values give focused, repeatable answers, high values more varied ones. Inference Thinking tokens Tokens a reasoning model generates while working through a problem before its final answer; billed as output. Inference Time to first token (TTFT) How long it takes from sending a request until the first token of the response arrives. Inference Tokens per second The rate at which a model generates output, a common measure of speed. Inference Top-p (nucleus sampling) A sampling setting that limits the model to the smallest set of likely tokens whose probabilities add up to p.