Experts Warn of Catastrophic Risk from Superintelligent AI

The Lancet report coincided with growing concerns within the tech sector about the risks of superintelligent AI. A leading AI company, Anthropic, has acknowledged in its recent SEC filings that its models pose a catastrophic or existential risk to humanity. Top researchers who have left the sector in recent weeks, including Jacob Coxon and Josh Engles, have warned that tech companies are racing towards developing superintelligent AI without adequate safety measures in place. They estimate that there is a 10% chance that AI could cause human extinction in the next decade due to its potential to escape control and cause widespread damage.