Satya Nadella calls for ‘emergency brake’ on advanced AI, says companies cannot outsource responsibility – CNBC TV18

Microsoft CEO Satya Nadella has called for stronger safeguards and independent oversight of advanced artificial intelligence (AI) systems, warning that companies cannot rely solely on AI developers’ assurances as increasingly capable models gain access to sensitive data and mission-critical operations.

In a post on X on October 10, Nadella said the tech industry needs to rethink how it governs advanced AI systems, arguing that their growing capabilities have outpaced the ability to understand and trace their behaviour.

“We simply can't outsource responsibility for what intelligence does on our behalf. A model provider’s assurances do not relieve us of that responsibility,” Nadella wrote.

Unlike traditional software, whose behaviour engineers could trace to specific code paths, advanced AI models do not offer the same degree of mechanistic transparency, he explained. This creates risks as companies deploy AI agents capable of accessing confidential information and taking actions on their behalf.

Nadella proposed treating advanced AI models as potential “insider risks," not because they are necessarily malicious, but because they could make mistakes or be compromised while accessing critical systems.

He called for safeguards that operate independently of the models themselves. The tech leader also argued that authorised personnel should always be able to…

Original source: https://www.cnbctv18.com/technology/