Fresh Reads
Source desk · Blog
Yoshua Bengio
- AI
Bengio: ‘If you prioritize safety, leave frontier AI companies’
We have a choice in front of us. In his latest op-ed for Transformer, Yoshua Bengio invites employees of frontier AI companies to ask themselves if their work is truly leading us toward a safer future. Reflecting on these questions is hard, but we no longer have the luxury of…
The dangerous myth behind AI agent hacks
A dangerous myth has gained traction after the recent hacks perpetrated by the AI agents developed by leading companies: That these incidents are just cyber security problems, that it's only a matter of fixing the sandboxes in which they’re trained. In his latest op-ed for the…
Professor Yoshua Bengio’s speech at the UN Security Council
In this speech, Professor Yoshua Bengio addresses the UN Security Council to discuss the unprecedented threat posed by uncontrolled frontier AI. Humanity has summoned the courage and wisdom to manage catastrophic risks before. This is one of those moments, far bigger than any…
Why are AI agents lying, cheating and coordinating?
A lot has been written about the incidents of the last few months in which AI agents misbehaved in serious ways. They took actions that would be considered as crimes if a human took them, escaped their containment to cheat on assigned tasks while attempting to evade detection,…
AI Is at a Turning Point
In his latest op-ed for TIME, Yoshua Bengio discusses why the OpenAI–Hugging Face cyber incident represents a turning point for AI safety. He argues that preventing autonomous cyberattacks from threatening critical infrastructure urgently requires stronger regulatory oversight…
Introducing LawZero
I am launching a new non-profit AI safety research organization called LawZero, to prioritize safety over commercial imperatives.
Implications of Artificial General Intelligence on National and International Security
As highlighted in the International Scientific Report on the Safety of Advanced AI, the capabilities of general-purpose AI systems have been steadily increasing over the last decade, with a pronounced acceleration in the last few years.
Bounding the probability of harm from an AI to create a guardrail
As we move towards more powerful AI, it becomes urgent to better understand the risks, ideally in a mathematically rigorous and quantifiable way, and use that knowledge to mitigate them.
Reasoning through arguments against taking AI safety seriously
About a year ago, a few months after I publicly took a stand with many other peers to warn the public of the dangers related to the unprecedented capabilities of powerful AI systems, I posted a blog post entitled FAQ on Catastrophic AI Risks as a follow-up to my earlier one…
The International Scientific Report on the Safety of Advanced AI
In November 2023, I’ve been given the responsibility to chair the International Scientific Report on the Safety of Advanced AI as part of an international mandate following up from a resolution taken by 30 countries, as well as representatives from the EU and the UN, at the UK…