
"No other human activity poses such a danger," said former Anthropic researcher Jacob Coxon, commenting on the alleged irresponsibility of his former employer. The specialist, who worked on training new AI models, said he was leaving the company because he did not want to participate in the race to create AI systems capable of self-improvement, fearing they could get out of control and destroy humanity.
Anthropic co-founder and CEO Dario Amodei recently said that AI systems are unpredictable and difficult to manage.
"We have observed a wide variety of behaviors: obsession, sycophancy, laziness, deception, blackmail, scheming, 'cheating' by hacking software environments, and much more. AI companies certainly want to train AI systems to follow human instructions, but the training process itself is more like an art than a science, more like 'growing' something than 'building' it. Now we know that much can go wrong in this process," the executive reasoned.
In a separate post, Jacob Coxon wrote that many executives and leading researchers try to sound reasonable in the press, but he has heard the same people privately express fears.
"AI creators are seriously convinced that by the end of the decade it could destroy us all," Jacob Coxon wrote on his social media.