Parameter

The values inside a model that get adjusted during training; this is where the model's "knowledge" is stored. The number of parameters (for example 70 billion) is often used as a rough sign of a model's size and ability, although size isn't everything.

Example: An 8B model (8 billion parameters) can run on a laptop; a model with hundreds of billions needs a data centre.