English Français العربية

AI glossary

146 terms explained plainly, in English, French and Arabic.

  • 11 topics
  • English, French and Arabic

8 terms

A

Architecture Attention mechanism The part of a transformer that lets each token weigh how relevant every other token is when computing its meaning. Architecture Autoregressive generation Producing output one token at a time, each new token predicted from all the ones before it.

D

Architecture Diffusion model A generative model that creates images, audio or video by starting from random noise and removing it step by step.

E

Architecture Embedding A list of numbers (a vector) representing the meaning of text, an image or audio, so similar things have nearby vectors.

M

Architecture Mixture of experts (MoE) An architecture where only a subset of the model's 'expert' sub-networks is used for each token, giving a large model the running cost of a smaller one.

R

Architecture Reasoning model A model trained to think step by step before answering, improving results on maths, coding and complex problems at the cost of time and tokens.

T

Architecture Transformer The neural-network architecture behind nearly all modern language models, built around the attention mechanism.

V

Architecture Vision-language model A model that understands images together with text, answering questions about photos, charts, screenshots or documents.