ElemedexA pocket encyclopedia of AI architectures
ENES

Elemedex: A pocket encyclopedia of AI architectures

TransformerNo. 025
Who’s that model?

Transformer

Evolution

AttentionTransducer

The Eevee of AI: BERT, GPT, T5 and almost everything that came after evolved from its basic form. It was born to translate English into German and French, and it reads every word at once, the way a graphics card paints every pixel. Its motto fits in the title of the paper that introduced it.

A
  1. 001McCulloch–Pitts neuron
  2. 002n-gram language model
  3. 003Logic Theorist
  4. 004Perceptron
  5. 005Naive Bayes
  6. 006ELIZA
  7. 007k-nearest neighbors
  8. 008k-means
  9. 009Expert system (MYCIN)
  10. 010Decision tree (ID3/C4.5)
  11. 011Multilayer perceptron (backprop)
  12. 012Simple recurrent network (Elman)
  13. 013Support vector machine
  14. 014Deep Blue
  15. 015LSTM
  16. 016Convolutional network (LeNet)
  17. 017Neural probabilistic language model
  18. 018AlexNet
  19. 019word2vec
  20. 020VAE
  21. 021GAN
  22. 022Seq2seq
  23. 023Bahdanau attention
  24. 024AlphaGo
  25. 025Transformer
  26. 026ELMo
  27. 027GPT-1
  28. 028BERT
  29. 029GPT-2
  30. 030T5
  31. 031Sentence-BERT
  32. 032GPT-3
  33. 033Retrieval-augmented generation (RAG)
  34. 034Diffusion model
  35. 035Vision Transformer (ViT)
  36. 036CLIP
  37. 037Chinchilla
  38. 038Gato
  39. 039ChatGPT (InstructGPT)
  40. 040LLaMA
  41. 041GPT-4
  42. 042LLM agent
  43. 043Mamba
  44. 044Mixture of experts (Mixtral)
  45. 045Reasoning model (o1, R1)
  46. 046Claude
  47. 047Gemini
  48. 048DeepSeek-V3
  49. 049Hopfield network
  50. 050AlphaFold 2
  51. 051Whisper
  52. 052SSM hybrid (Jamba, Qwen3.5)
  53. 053Diffusion language model (LLaDA)
  54. 054AlphaStar

54 species · ← → ↑ ↓ to move · Enter to open

Filter by type
Generation

A pocket encyclopedia of AI architectures, from McCulloch and Pitts’s neuron to reasoning models. Every entry has its anatomy, its stats, its lineage and a philosophical note; every technical term, its technical machine.

How to read an entryGlossary (TM)LegendariesLab