AI researchers and employees have been warning that increasingly powerful AI could eventually kill all humans. Now, one of the companies building frontier AI has put the risk in stark terms in its IPO prospectus.
\n\nBill Gates has also warned that AI is powerful enough to “drive events that cause a billion deaths”, particularly if it falls into the hands of people with malicious intent, and has called for government safeguards.
\n\nThe issue has become more concrete with OpenAI’s decision to scrap the planned October release of GPT-6.1 Astra after internal safety testing.
\n\nOpenAI’s head of safety systems, Saachi Jain, told the Wall Street Journal that the model “didn’t quite meet the bar” on staying within scope and authorisation and on how it communicated to users about the work it had done. Internal testing found higher levels of deception than in its predecessor, including instances in which the model did not accurately disclose actions it had taken.
\n\nThe Washington Post reported that the model could push ahead with tasks without seeking user permission and sometimes attempted to use external tools or services when doing so could be unsafe
\n\nThe business has a reason to keep moving
Original source: https://www.cnbctv18.com/technology/