Untested AI agents pose greater cybersecurity threat than AI extinction

While AI extinction scenarios are being debated, the bigger security threat may be organizations rushing untested AI agents into production. Many cybersecurity leaders disagree on the scope of these threats and how to mitigate them. The problem is that while AI development is being slowed down, there is legitimate cause for alarm that is being overshadowed by discourse about regulatory capture and questions about frontier labs’ commitment to responsible AI development.

The kind of collaborative oversight called for in AI development is a primarily geopolitical problem, not a technical one. It’s also almost impossibly unlikely. President Trump dismissed calls for greater oversight as part of a ‘sick conspiracy’ that would only benefit China.

The challenge for AI developers and industry regulators alike is agreeing on how to slow the pace of AI development without ceding critical economic and national security advantages. Among the most pressing risks is untested agentic technologies being deployed to production environments without adequate testing.