AI Governance Library

Policy Proposals: Artificial Intelligence: The Opportunity to Transform the UK’s Resilience to Extreme Risks

A three-page set of policy proposals for UK AI governance. It recommends government expertise, AI assurance and risk-management measures, and international cooperation on safe and responsible AI.
Cover of Policy Proposals: Artificial Intelligence: The Opportunity to Transform the UK’s Resilience to Extreme Risks

⚡ Quick Summary

Published by The Centre for Long-Term Resilience, this three-page policy-proposals document sets out an AI agenda intended to strengthen the UK’s resilience to extreme risks. It calls for a “world-leading, effective AI governance regime” that allows the UK to realise AI’s benefits while mitigating risks. Its proposals are directed primarily at UK government departments, regulators, academia and the private sector, while also addressing international cooperation.

The document groups its recommendations around three aims: increasing AI expertise in government; promoting safe and trustworthy AI development and deployment through incentives, norms, processes and governance structures; and facilitating cooperation across nations and sectors. It proposes dedicated AI roles in departments including the Ministry of Defence and the Information Commissioner’s Office, civil-service training, and a secondment or fellowship programme for AI ethics and governance experts. It also recommends monitoring AI inputs such as data and compute, horizon scanning, research investment in safety, security and interpretability, an AI assurance ecosystem, red-teaming and throughout-lifetime stress-testing, and review of AI in high-risk domains.

🧩 What’s Covered

The proposals proceed from government capability to domestic governance and then international cooperation:

  • Government expertise: Recommends specific technical AI roles in key departments and regulators, naming the Ministry of Defence and Information Commissioner’s Office, alongside an AI and machine-learning training programme for existing civil servants. The aim is for government to understand AI capabilities, impacts, risks and policy implications.
  • External expertise: Proposes a secondment or fellowship programme, described as similar to TechCongress, to place specialists in AI ethics and governance in relevant areas of government.
  • Monitoring and foresight: Calls for capacity and infrastructure to monitor progress in AI. This includes collecting information on inputs such as data and compute, tracking models affecting UK citizens and business, and linking coordinated foresight and horizon-scanning programmes to policy and regulatory decisions.
  • Safety research and assurance: Recommends investment in academic and private-sector research on AI safety, security and interpretability, plus student fellowships to develop talent. It calls for an effective UK AI assurance ecosystem in line with recommendations from the CDEI’s roadmap.
  • Regulatory implementation: Proposes implementing the UK’s AI regulatory regime in line with recommendations of the Office for AI’s forthcoming whitepaper.
  • Government risk management: Recommends red-teaming exercises and throughout-lifetime stress-testing for AI systems used by government, and exploration of industry risk-management practice including three lines of defence.
  • High-risk applications and international norms: Calls for review of AI used in weapons systems, nuclear command and control, and critical infrastructure, with robust assurance and possible restrictions where risks outweigh benefits. It also proposes international dialogue on AI in warfare, technical standards through bodies such as the OECD and UN, cybersecurity resources, and academic capacity to verify and challenge industry claims.

💡 Why it matters?

For public-sector leaders and regulators, the document turns broad AI-governance objectives into institutional actions: build technical capacity, obtain external expertise, monitor technical developments, and test systems used by government throughout their lifetime. It places assurance and risk management alongside research and workforce development rather than treating them as separate activities.

The recommendations also identify settings where failures could have particularly serious consequences, including weapons systems, nuclear command and control and critical infrastructure. Its proposed red-teaming, stress-testing and review mechanisms therefore provide a concise starting point for teams considering how to govern high-risk government uses of AI.

❓ What’s Missing

This is a short policy-proposals document rather than an implementation plan. It does not define AI, AI assurance, red-teaming, interpretability or the three lines of defence, nor does it prescribe detailed methodologies for applying them. The proposals do not specify delivery owners, budgets, timelines, legislative changes, thresholds for determining when risks outweigh benefits, or measures for judging success. Although it refers to the CDEI roadmap and a forthcoming Office for AI whitepaper, it does not reproduce their recommendations. The document also names high-risk domains but does not give case studies, system-level technical requirements or worked examples of assurance mechanisms for those domains.

👥 Best For

UK civil-service and regulatory leaders planning AI capability and oversight arrangements will find the recommendations most directly relevant. It is also suited to public-sector risk, assurance and procurement teams considering testing of government AI systems; policy teams examining high-risk applications; and researchers or industry participants involved in safety, security, standards and independent challenge.

📄 Source Details

Policy Proposals: Artificial Intelligence: The Opportunity to Transform the UK’s Resilience to Extreme Risks was published by The Centre for Long-Term Resilience in September 2022. The three-page English document identifies Dr Jess Whittlestone, Head of AI Policy at The Centre for Long-Term Resilience. The complete PDF was available for review. No URL to the PDF is printed in the document.

About the author
Jakub Szarmach

AI Governance Library

Curated Library of AI Governance Resources

AI Governance Library

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to AI Governance Library.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.