ElemedexA pocket encyclopedia of AI architectures

Glossary (TM) › Use: prompts, sampling, systems

TM144

Agent

Also: AI agent, LLM agent, language agent

In Spanish: Agente

A system that perceives and acts on its environment to achieve a goal; today, typically, a language model deciding in a loop which tools to use and when.

The word has two lives. In reinforcement learning, an agent is any system that observes an environment, chooses actions according to a policy and receives rewards: the Atari player, or AlphaGo. In recent jargon, an agent is a system that uses a language model to decide which actions to take and in what order, with two key components: tools to do what the model cannot do alone (tool use) and a strategy for planning (Alammar & Grootendorst, 2024, p. 218).

The most influential scheme is ReAct, which interleaves reasoning and acting (Yao et al., 2023). The model repeats a three-step cycle (Alammar & Grootendorst, 2024, p. 219):

Thought: I need the current price in dollars and then convert it to euros. Action: search["MacBook Pro price"] → Observation: a list of prices in USD… Thought: now I use the calculator with the exchange rate…

On questions that require looking things up in Wikipedia, ReAct reduced the hallucination and error propagation of pure chain of thought reasoning (Yao et al., 2023). Since 2025, the most visible variant has been coding agents, which read a repository, edit files and run tests over many steps (LLM agent).

Are they agents in the philosophical sense? Millière & Buckner (2024b) raise the question: they are described as systems that generate, store and break down goals, yet they have no intrinsic goals or motivations; whether the word is a misnomer depends on how thick one's notion of agency is (2024b, sec. 3.1). From the side of intentionality, Dennett (1987) offers a tempting answer: if adopting the intentional stance toward the system predicts its behavior well, that is all there is to having beliefs and desires. Skeptics reply that the goal really lives in the prompt somebody else wrote.

Sources

  • Alammar, J., & Grootendorst, M. (2024). Hands-on large language models: Language understanding and generation. O’Reilly Media. §
  • Dennett, D. C. (1987). The intentional stance. MIT Press. §
  • Millière, R., & Buckner, C. (2024b). A philosophical introduction to language models—Part II: The way forward (arXiv:2405.03207). arXiv. https://doi.org/10.48550/arXiv.2405.03207 §
  • Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2023). ReAct: Synergizing reasoning and acting in language models. In 11th International Conference on Learning Representations (ICLR 2023). https://openreview.net/forum?id=WE_vluYUL-X §