Foundation model

A large model trained on broad data that can be adapted to many different tasks.

Instead of training a separate model for every job, one foundation model is trained once at great cost and then prompted or fine-tuned for translation, coding, support, analysis and more.

All terms

In other languages

Modèle de fondation Français
النموذج الأساسي العربية

Related terms

Large language model (LLM)A neural network trained on very large amounts of text to predict the next token, which lets it write, answer questions, summarise, translate and code.
Fine-tuningFurther training of an existing model on a smaller, specific dataset to specialise it for a task, style or domain.
Pre-trainingThe first, largest stage of training, where a model learns language and world knowledge by predicting text across a huge dataset.

Frequently asked questions

What does Foundation model mean?

A large model trained on broad data that can be adapted to many different tasks. Instead of training a separate model for every job, one foundation model is trained once at great cost and then prompted or fine-tuned for translation, coding, support, analysis and more.