Should we slow AI down?
Researchers in Canada and elsewhere warn that advanced AI could escape human control. Read their arguments and the proposals for responding to that risk.
Where do I stand?Canadian voices
Two of the three Turing Award winners for deep learning built their careers in Canada. Both now say the technology they created could escape human control.
-
Yoshua Bengio
Université de Montréal and Mila. Turing Award. Chaired the International AI Safety Report.
“Rogue AI may be dangerous for the whole of humanity. Banning powerful AI systems (say beyond the abilities of GPT-4) that are given autonomy and agency would be a good start.”
“It's very hard, in terms of your ego and feeling good about what you do, to accept the idea that the thing you've been working on for decades might actually be very dangerous to humanity.”
Further reading
- His French FAQ on catastrophic AI risks · yoshuabengio.org
- How rogue AIs may arise — his own account of changing his mind · yoshuabengio.org
- The International AI Safety Report, which he chairs · International AI Safety Report
- LawZero, the Montréal non-profit he founded · LawZero
-
Geoffrey Hinton
University of Toronto. Nobel Prize in Physics 2024. Turing Award.
“It is inspiring to see Canadian parliamentarians on both sides of the aisle directly confront the risk posed by superintelligence. This is one of the defining challenges of our era, and it will shape the life of every Canadian citizen. It's about time we address it.”
“If you take the existential risk seriously, as I now do, it might be quite sensible to just stop developing these things any further.”
“The research question is: how do you prevent them from ever wanting to take control? And nobody knows the answer.”
Further reading
- The one-sentence statement on extinction risk he signed · Center for AI Safety
- More quotations · PauseAI
-
David Krueger
Mila and Université de Montréal. Founding CEO of Evitable.
“To proceed towards superintelligent AI without any concrete plan to control it is completely unacceptable. Developers cannot currently comply with any effective regulation because they do not understand what they are building.”
“AI is not inevitable.”
Further reading
- His blog, The Real AI · Substack
- Evitable, the non-profit he founded · Evitable
- The statement on extinction risk he signed · Center for AI Safety
-
Wyatt Tessari L'Allié
Founder and executive director, AI Governance & Safety Canada.
“Certain AI capabilities pose an unacceptable risk because they could lead to dangerous weaponization or loss of control scenarios: systems that, without the instruction or authorization of their users, can detect and evade monitoring, rewrite their own code, make copies of themselves, spawn other AI systems, commandeer resources or refuse shutdown.”
“What can we do in and from Canada to ensure that AI is safe and benefits everyone?”
Further reading
- His March 2026 testimony in full, from Hansard · openparliament.ca
- AI Governance & Safety Canada, the organization he runs · AIGS Canada
-
Gillian Hadfield
Johns Hopkins, on leave from the University of Toronto. Canada CIFAR AI Chair at the Vector Institute.
“Governments require the targets of regulation to purchase regulatory services from a government-licensed private regulator.”
Further reading
- Regulatory Markets: The Future of AI Governance · arXiv
- An interview on building rules AI can actually follow · AIhub
- Her profile at the Vector Institute · Vector Institute
Parliamentarians have already signed
Current and former Canadian parliamentarians from several parties have signed a statement calling for an international agreement to prohibit superintelligent AI. Read the statement and see who has signed.
House of Commons
- Hon. Judy A. Sgro · Liberal
- Hon. Jonathan Wilkinson · Liberal Former MP
- Hon. Steven Guilbeault · Liberal Former MP
- William Stevenson · Conservative
- Grant Jackson · Conservative
- Jeremy Patzer · Conservative
- Joël Godin · Conservative
- Cathay Wagantall · Conservative Former MP
- Arnold Viersen · Conservative
- Martin Champoux · Bloc Québécois on behalf of the Bloc Québécois MPs
- Simon-Pierre Savard-Tremblay · Independent Former MP
Senate
- Hon. Colin Deacon · CSG
- Hon. Tony Loffreda · ISG
- Hon. Kim Pate · ISG
- Hon. Paulette Senior · ISG
- Hon. Judy A. White · PSG
- Hon. Tracy Muggli · PSG
- Hon. Julie Miville-Dechêne · PSG
- Hon. Jim Quinn · Conservative
- Hon. Mary Jane McCallum · Conservative
The arguments
Start here
-
What is actually being built
Systems that write code, use tools and pursue goals over hours without supervision — and why the labs building them say so themselves.
PauseAI
Read it Bookmark -
The questions people ask first
Is this science fiction? Is it not just hype? What about the benefits? Pause IA's answers, written in French for a French-speaking public.
PauseAI fr
Read it Bookmark
Understand the risk
-
The International AI Safety Report
An international review of AI capabilities, harms and remaining uncertainties, chaired by Yoshua Bengio.
International AI Safety Report · Chaired by Yoshua Bengio Canada
Read it Bookmark -
Why researchers talk about existential risk
Why an AI system pursuing a goal might seek resources or resist being shut down.
PauseAI
Read it Bookmark -
What is at stake for everyone
A French introduction to loss of control and the concentration of power that advanced AI could bring.
PauseAI fr
Read it Bookmark -
A parliamentary review of systemic and existential AI risk
A French parliamentary report comparing expert views on systemic and existential AI risks.
Sénat français — OPECST fr
Read it Bookmark -
How rogue AIs may arise
Yoshua Bengio explains how current training methods could produce AI systems with harmful goals.
yoshuabengio.org · Yoshua Bengio Canada
Read it Bookmark
Possible responses
-
What a pause would and would not stop
PauseAI’s proposal for an international pause on training the most powerful general AI systems, with independent oversight.
PauseAI
Read it Bookmark -
The same case, in French law and politics
How Pause IA translates the argument into concrete demands on a European government — a useful comparison for what Canada could ask for.
PauseAI fr
Read it Bookmark -
LawZero: building AI that does not act on its own
Bengio's answer to "so what should we build instead": AI that reasons and explains but does not act, designed so its safety can be checked.
LawZero · Founded by Yoshua Bengio Canada
Read it Bookmark
Can countries coordinate?
-
Why a pause might not work
PauseAI responds to objections about international cooperation, existing models and enforcement.
PauseAI
Read it Bookmark -
Could a treaty be enforced?
Frontier training needs enormous, physically traceable compute in a handful of data centres, built on chips from very few suppliers. That is what makes verification thinkable.
PauseAI
Read it Bookmark
Why your voice counts
-
AI Governance & Safety Canada
The organization that has been making this case to Canadian parliamentary committees since 2022, with the submissions and testimony to show for it.
AI Governance & Safety Canada Canada
Read it Bookmark -
Who else says this, in their own words
The CEOs of OpenAI, Anthropic and Google DeepMind have all signed a statement putting AI extinction risk alongside pandemics and nuclear war.
PauseAI
Read it Bookmark
Take part
Join Us
Newsletter
News about AI policy in Canada, meetings and ways to take part. Unsubscribe at any time.
Your account
Keep a record of your actions and save resources to return to later.
Create an accountCreating an account does not subscribe you to the newsletter.
Meet other people at our gatherings and find ways to act together.
Upcoming events