Businesses Urged to Test AI-Enabled Security's Decision-Making

An AI-enabled defence system should be able to make a mistake without giving that mistake control of the business, according to Cyber Insight. The company argues that detection accuracy and speed remain important, but the systems surrounding AI deserve just as much scrutiny. A tool that summarises an investigation does not carry the same operational responsibility as a workflow that can disable accounts or isolate systems.

Cyber Insight draws a distinction between using AI to interpret information and granting a system authority to change the environment. The company recommends examining both outcomes when assessing a security design, including what permissions constrain a compromised account and what checks protect a sensitive transaction.

The company believes a useful test of cyber defence is what happens after an individual control or assessment falls short. They recommend testing whether the response remains proportionate and whether essential business functions have appropriate protection when something goes wrong.