Basics
Parameter
A number inside a model that is learned during training; a model's size is usually counted in parameters.
Parameters, mostly the weights of a neural network, encode everything a model has learned. A '70B' model has about 70 billion of them. More parameters generally mean more capability, but also more memory and compute to run.
Frequently asked questions
What does Parameter mean?
A number inside a model that is learned during training; a model's size is usually counted in parameters. Parameters, mostly the weights of a neural network, encode everything a model has learned. A '70B' model has about 70 billion of them. More parameters generally mean more capability, but also more memory and compute to run.