AI Governance Library

Navigating the AI Frontier: A Primer on the Evolution and Impact of AI Agents

A World Economic Forum white paper, produced with Capgemini, defining AI agents, tracing their evolution from rule-based systems to multi-agent systems, and setting out technical, socioeconomic and ethical risks with possible mitigation measures.
Cover of Navigating the AI Frontier: A Primer on the Evolution and Impact of AI Agents

⚡ Quick Summary

Published by the World Economic Forum in collaboration with Capgemini, this white paper examines how AI agents have evolved and what their deployment implies for governance. Drawing on the ISO/IEC 22989:2023 definition, it describes an AI agent as an entity that senses percepts through sensors and responds through effectors to its environment, with the autonomy and authority to act on specified goals.

The paper traces development from 1950s rule-based systems through machine learning and neural networks to the rise of large language models since 2017, then sets out four agent types – simple reflex, model-based reflex, goal-based and utility-based – and the components of advanced agents: a control centre, model, decision-making and planning with chain-of-thought reasoning, memory management, tools, effectors, learning and an application layer. It introduces AI agent systems, mixture-of-agents and central orchestration designs, and multi-agent systems using network and supervised architectures, illustrated by an in-car infotainment agent, autonomous vehicle systems and vehicle-to-everything smart city traffic management.

A closing section groups risks as technical, socioeconomic and ethical and proposes measures including behavioural monitoring, information transparency, public education and clear ethical guidelines, concluding that cross-sectoral consensus and further research are needed.

🧩 What’s Covered

  • Definition of an AI agent: drawn from ISO/IEC 22989:2023, covering autonomy, authority and the core components shown in Figure 1 – user input, environment (physical or digital infrastructure), sensors, control centre, percepts, effectors and actions.
  • The evolution of AI agents: from 1950s deterministic rule-based systems to probabilistic, non-deterministic behaviour, the 1990s machine-learning turn and neural networks, and large language models since 2017; section 2.1 adds large models and five learning techniques – supervised learning, reinforcement learning, reinforcement learning with human feedback, transfer learning and fine-tuning.
  • Types of AI agents: a table contrasting deterministic and non-deterministic characteristics, plus definitions and examples of simple reflex, model-based reflex, goal-based and utility-based agents, from spam filters and smart thermostats to chess engines, robot-advisers and healthcare diagnosis assistants.
  • Advanced AI agents: Figure 3 sets out the control centre as an orchestration layer, the model, decision-making and planning with chain-of-thought reasoning, memory management, tools, effectors, learning and the application layer, with a car infotainment agent as a worked example.
  • AI agent systems: heterogeneous or homogeneous agents sharing data to meet a system goal, with mixture-of-agents and central orchestration designs, illustrated by an autonomous vehicle system using perception, localization, planning and control agents.
  • Towards multi-agent systems: network and supervised architectures (Figure 4), Figure 5 relating agent, agent system and MAS, and a smart city traffic management example using vehicle-to-everything communication.
  • Interoperability: predefined versus emergent communication protocols, with decoding emergent communication described as an ongoing research challenge and human-interpretable messages required for reliability.
  • Looking ahead: benefits in software development, healthcare, customer experience, education and finance; risks categorized as technical (specification gaming, goal misgeneralization, deceptive alignment, malicious use, validation and testing challenges), socioeconomic and ethical; and measures spanning information transparency, behavioural monitoring, public education, a forum for public concerns, deployment strategies and ethical guidelines.

💡 Why it matters?

The primer gives governance, risk and engineering audiences a shared vocabulary for a moving target: what an AI agent is, how agent systems and multi-agent systems differ, and where autonomy and authority enter the picture. Its risk taxonomy – technical, socioeconomic and ethical – and its point that harm depends on the deployment context, from healthcare to customer service, help teams scope assessments rather than treat agent risk as uniform. Its stated reliance on ISO/IEC 22989:2023 terminology and its call for governance frameworks covering design, development, deployment and use give a reference point for structuring reviews of agentic deployments.

❓ What’s Missing

The treatment is conceptual rather than operational. Risks are listed as examples without likelihood, severity scales or metrics, and the mitigation measures are indicative, with no thresholds, controls, roles or test procedures. The document does not map its discussion to named regulatory instruments and offers no sector-specific guidance or worked governance model. It notes that interoperability protocols still need to be debated and agreed by a wider community, and states repeatedly that further research is needed on safety, security and socioeconomic implications, so the paper is a framing exercise rather than a source of implementable requirements.

👥 Best For

Policy analysts and AI governance leads needing a concise, citable account of what AI agents are and which risks they raise; risk and safety teams building a first-pass risk taxonomy for agentic deployments; product, architecture and engineering staff who need shared terminology before designing oversight and monitoring; and educators preparing introductory material on autonomous systems.

📄 Source Details

Navigating the AI Frontier: A Primer on the Evolution and Impact of AI Agents, a white paper published by the World Economic Forum in collaboration with Capgemini, dated December 2024, 28 pages, in English. The foreword is signed by Fernando Alvarez (Capgemini) and Jeremy Jurgens (World Economic Forum); contributors are listed for the Forum's AI Governance Alliance Safe Systems and Technologies working group and for Capgemini, followed by acknowledgements and endnotes. No document URL is printed in the text. The full text of all 28 pages was available for this review.

About the author
Jakub Szarmach

AI Governance Library

Curated Library of AI Governance Resources

AI Governance Library

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to AI Governance Library.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.