ElemedexA pocket encyclopedia of AI architectures

Glossary (TM) › Machine learning fundamentals

TM023

Model

In Spanish: Modelo

A word with several senses in AI: an architecture, a set of trained weights, or a product; and, in logic, something almost the opposite.

Few words change their referent so often within a single conversation. It helps to separate at least three technical uses:

  1. The architecture. "The transformer model" names a computational recipe: a space of possible functions, not yet trained (see architecture).
  2. The trained weights. One particular point in that space, fixed by training. Chollet (2021) says it plainly: given the same data and the same architecture, different sets of weight values are different "models" (2021, sec. 5.4.4). When a model is released openly, what is shared is the weights together with the architecture (Alammar & Grootendorst, 2024, p. 30).
  3. The product. ChatGPT (InstructGPT) is not just a set of weights but a system with a system prompt, filters, tools, and an interface. That is why Elemedex sorts its species into architectures, models and systems (besides algorithms and units).

Beneath all three lies the statistical sense: a family of functions or probability distributions with adjustable parameters. What a learning method produces is, for Witten et al. (2017), a kind of "theory" of the domain, in the modest sense of something that predicts unseen cases (2017, p. 197).

The logician should beware of a false friend. In model theory, a model is a structure that makes true the sentences of a theory: the world interprets the language. In machine learning the direction is reversed: the model is the (approximate, numerical) theory, and the data are the world it is fitted to.

One rhetorical ambiguity remains. From the fact that a language model is a model, a simulation, people sometimes infer that it cannot understand anything. Santelli (2026) notes that this conclusion, far from reassuring, feeds the fear of capable systems that do not understand what they do. Either way, the word alone does not settle the question of understanding.

Sources

  • Alammar, J., & Grootendorst, M. (2024). Hands-on large language models: Language understanding and generation. O’Reilly Media. §
  • Chollet, F. (2021). Deep learning with Python (2nd ed.). Manning Publications. §
  • Santelli, M. (2026, August 25). El futuro de la IA: Entre doomers y hyperos. 421.news. https://www.421.news/es/ia-doomers-hyperos/ §
  • Witten, I. H., Frank, E., Hall, M. A., & Pal, C. J. (2017). Data mining: Practical machine learning tools and techniques (4th ed.). Morgan Kaufmann. https://doi.org/10.1016/C2015-0-02071-8 §