Insider warnings over AI fall flat with some in Silicon Valley - BBC NewsBBC HomepageSkip to contentAccessibility HelpYour accountHomeNewsSportEarthReelWorklifeTravelCultureFutureMusicTVWeatherSoundsMore menuMore menuSearch BBCHomeNewsSportEarthReelWorklifeTravelCultureFutureMusicTVWeatherSoundsClose menuBBC NewsMenuHomeClimateWorldUS & CanadaUKBusinessTechScienceEntertainment & ArtsHealthMoreIn PicturesBBC VerifyNewsbeatBusinessNew Tech EconomyArtificial IntelligenceTechnology of BusinessAfrica BusinessPaths to SuccessDramatic insider warnings over AI fall flat with some in Silicon ValleyImage source, ReutersByLily JamaliNorth America technology correspondent, Reporting fromin San FranciscoPublished12 September 2026Updated 5 minutes agoEach September, a who's who of executives from across Silicon Valley descends on San Francisco's Palace Hotel to charm investors at a conference hosted by the investment bank Goldman Sachs.This past week, between talk of growth and potential returns, tech titans found themselves addressing the abrupt resignation of Anthropic researcher Jacob Coxon.Coxon, a 27-year-old who worked at OpenAI before joining its chief rival Anthropic, said on Tuesday that people building artificial intelligence (AI) believed the technology could destroy humanity. They are "gambling with our lives", he said, "these will soon be superhuman systems that can hack anything".Coxon is by no means the first AI insider to publicly sound the alarm. There have been a string of high-profile resignations from both Anthropic and OpenAI in recent years over apparent safety concerns, and some current Anthropic employees even echoed Coxon's post."We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade," a team lead at Anthropic, Evan Hubinger, posted on X.While Coxon said explicitly in his posts that his warnings were "not marketing", some executives and investors in Silicon Valley have reacted with scepticism to a recent flurry of insiders sounding the alarm.Anthropic and OpenAI are reportedly preparing for potentially record-setting initial public offerings, and some in the tech sector have suggested the latest stark comments about the dangers of AI may be designed to generate hype by signalling the power of these products.Anthropic's boss, Dario Amodei, has come under fire for saying AI technology could wipe out half of entry-level white-collar jobs and will "test who we are as a species".One conference speaker, Grindr CEO George Arison, told the BBC he believed this week's comments from Coxon and others were indicative of an "anti-civilisational worldview at Anthropic".He called them "dangerous" and said they had prompted him to instruct some engineers at the LGBTQ+ dating app to stop using Anthropic's technology."It is irresponsible for us as stewards of our shareholders' money to be relying on a business that does what this company does, in terms of its public statements," he said."Maybe they actually believe it," Arison said. "Or you could argue they're saying it because it's a great way to gin up more investor support, because the only way to justify these valuations is to actually claim: 'I'm going to take over every industry and I'm going to take over every job, and my AI is going to be doing all that work.'"Anthropic was valued at $965bn (£713bn) in its most recent fundraising round earlier this year.The BBC has asked Anthropic for a response to the statements.In an essay posted early on Saturday, Amodei called for a slowing of AI model development and global regulation - and said the risks associated with AI were "serious".Anthropic boss Dario Amodei calls for AI development to slow downPublished11 hours agoAnthropic researcher believes more than 10% chance AI 'could kill all humans'Published3 days agoWhy some experts increasingly fear AI will take overPublished3 days agoImage source, Getty ImagesImage caption, Grindr CEO George Arison told the BBC he believed some of the stark public warnings about AI were "dangerous"Nvidia boss Jensen Huang also discussed Coxon's comments before a crowd at the conference, multiple people in the group told the BBC. They said he dismissed them as untrue.Huang has previously said the notion that AI "is going to be the end of humanity" is "complete nonsense". And while he may have a business interest in an AI boom - Nvidia builds chips that power AI systems - his comments reflect a growing backlash in Silicon Valley to the existential warnings from current and former staffers.Some critics have even accused Anthropic of fearmongering in hopes that it will trigger a regulatory push that could shut out competition and leave it and OpenAI with a duopoly in the sector.Brad Gerstner, who is the head of the investment firm Altimeter Capital, posted pictures of Huang from the conference and accused Coxon of "ridiculous hyperbole".On Friday, the CEO of the AI platform Hugging Face, Clement Delangue, weighed in. Hugging Face, which Nvidia announced it would acquire last week, was hacked by OpenAI agents earlier this year prompting an outcry over AI safety."Sorry, but asking Jacob about AI extinction risk is like asking your AC guy about climate change," he wrote on X. "Not saying it's necessarily uninteresting or wrong per se but let's keep things in perspective."Both Gerstner and Delangue were more circumspect on Saturday after Amodei's proposal was posted, with Gerstner calling the idea "an important step forward" in balancing competing considerations like speed and safety. Delangue offered to help be a part of the potential solutions proposed by Amodei.Could insider warnings prompt a crackdown?In April, Anthropic roiled the AI world when it said it found that its Mythos tool could outperform humans at some hacking and cybersecurity tasks.Mythos also showed the ability to independently escape what is known as the sandbox environment, setting off a debate among regulators, legislators and businesses about AI's potential dangers.In a new development on Thursday, Anthropic said it had found and stopped threat actors who were trying to use its AI technology for activity including the development of bioweapons and cyber-espionage. Beneath the sparkling chandeliers hanging in the stained-glass dome atrium of The Palace Hotel, some investors told the BBC that the comments from Coxon and others could accelerate a government crackdown.To play this video you need to enable JavaScript in your browser.This video can not be playedFigure caption, Watch: "Slow it down" - Bernie Sanders proposes bill to ban AI superintelligenceFederal legislation co-sponsored this month by left-wing Senator Bernie Sanders of Vermont, known as the Ban Artificial Superintelligence Act, would impose a temporary pause in advanced AI development."There is a good chance that human beings will lose control over AI," Sanders told the BBC's Newsnight programme on Thursday. "And what happens then, nobody knows. But could it be catastrophic? Yes, it could.""When scientists tell you there is a chance that it could have a cataclysmic impact on humanity, you've got be a moron not to say, slow it down," he added.If an industry-wide government crackdown comes, however, it is likely to be led by legislators and not the Trump administration which largely supports a policy of unfettered AI development. It has framed this as necessary to ensure the US does not cede dominance to China.Speaking to reporters this week, President Donald Trump was asked if he had any concerns about AI leading to human extinction. "No, I don't have any," he said. "I have concerns that if we don't win AI, we're going to be put in a very bad position. We are leading China right now."But the president's relationship with Anthropic has been turbulent. After the company refused to allow the US military to use its AI models, the White House described it as "a radical left, woke company" and designated it a supply chain risk, a move that a federal judge has ruled was illegal.David Sacks, Trump's AI czar in the early days of his administration, has also levelled repeated attacks at Anthropic. OpenAI has not endured the same level of scrutiny from the White House. When releasing a new model called Astra last week, OpenAI President Greg Brockman described his firm's relationship with the Trump administration as "a very good partnership".The company did not respond to a BBC inquiry seeking comment.At the conference in San Francisco this week, the pursuit of fortunes seemed to mostly trump any mounting existential concerns or fears over potential government restrictions on AI.OpenAI, which was most recently valued at $852bn, has previously announced plans to allow people to buy shares in its firm by listing on the stock market.However, its chief executive Sam Altman said on Friday this would not happen this year, calling it an "ill-advised moment" to do so "given everything happening with safety" in an interview with Fortune magazine. He suggested 2027 would be more likely.Meanwhile, one investor said he was looking forward to Anthropic's forthcoming S-1, a document a company must file with securities regulators in order to sell shares.His main question about the company was simple: is the firm profitable?When asked on Thursday if he fears the world may be coming to an end, Sid Sheth - CEO of the chip company d-Matrix which inked a deal with Nvidia at the conference that day - did not mince his words."No," he said.Sign up for our Tech Decoded newsletter to follow the world's top tech stories and trends. Outside the UK? Sign up here.Related topicsArtificial intelligenceMore on this storyAnthropic blocks possible attempt to use AI to make biological weaponsPublished2 days agoWhat is Claude Mythos and what risks does it pose?Published17 AprilThe video playlistWatch our pick of standout clips from across the BBCPreviousNext1:36Does this AI comic make you laugh? 00:01:36, play videoDoes this AI comic make you laugh?0:49Are the UK's spiders getting bigger? 00:00:49, play videoAre the UK's spiders getting bigger?0:57'I was a commodity': Charlotte Church on the music industry. 00:00:57, play video'I was a commodity': Charlotte Church on the music industry0:23Things heat up in the Celebrity Masterchef kitchen. 00:00:23, play videoThings heat up in the Celebrity Masterchef kitchen0:57What just happened with Trump's united Ireland call. 00:00:57, play videoWhat just happened with Trump's united Ireland call0:50Wembley Stadium's first ever Punjabi artist headliner. 00:00:50, play videoWembley Stadium's first ever Punjabi artist headliner0:59When a Dragon gives you a helping hand. 00:00:59, play videoWhen a Dragon gives you a helping hand1:02Why should young people care about pensions? 00:01:02, play videoWhy should young people care about pensions?1:30My attacker 'doesn't get to be the storyteller' 00:01:30, play videoMy attacker 'doesn't get to be the storyteller'1:07The 3D scans giving blind parents a new way to meet their baby. 00:01:07, play videoThe 3D scans giving blind parents a new way to meet their baby1:11Are women better at endurance running than men? 00:01:11, play videoAre women better at endurance running than men?1:20Why is Donald Trump visiting the Republic of Ireland? 00:01:20, play videoWhy is Donald Trump visiting the Republic of Ireland?0:54'This ceremony is essential' says brother of 9/11 victim. 00:00:54, play video'This ceremony is essential' says brother of 9/11 victim1:31Inside Gander: The town that took in thousands on 9/11. 00:01:31, play videoInside Gander: The town that took in thousands on 9/110:57'Extraordinary' - MPs reject assisted dying bill. 00:00:57, play video'Extraordinary' - MPs reject assisted dying bill1:17Céline Dion duets with fan ahead of Paris comeback concert. 00:01:17, play videoCéline Dion duets with fan ahead of Paris comeback concert0:09US President Donald Trump snaps at ABC reporter. 00:00:09, play videoUS President Donald Trump snaps at ABC reporter0:56British victims remembered at 9/11 memorial in London. 00:00:56, play videoBritish victims remembered at 9/11 memorial in London0:41'I want to play for Mum' – Arsenal's Cooney-Cross. 00:00:41, play video'I want to play for Mum' – Arsenal's Cooney-Cross1:28India's 'cockroaches' want to fix schools. 00:01:28, play videoIndia's 'cockroaches' want to fix schoolsTop storiesAI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBCPublished2 hours agoDramatic insider warnings over AI fall flat with some in Silicon ValleyPublished5 minutes agoLive. Reform's £72m donations 'entirely in line with law', Jenrick says2780 viewing2.8k viewingMore to exploreWill the Thirlwall report change the debate about Lucy Letby?'She's back': Fans dance, sing and cry after Céline Dion's comeback concert in Paris. Video'She's back': Fans dance, sing and cry after Céline Dion's comeback concert in ParisSome dentists say more young people are grinding their teeth - are you one of them?The Papers: 'Nigel hits the jackpot' and 'Dark day for democracy'Five night sky events to look out for this autumnBest friends for decades - until a DNA test revealed they were sistersHaving a stroke at 26 was massive learning curveDrag Race co-creator warns of TV representation 'crisis' after BBC drops showUS Politics Unspun: Cut through the noise with Anthony Zurcher's newsletterElsewhere on the BBCHow a woman's sudden death triggered a six-month manhuntAbercrombie & Fitch's former CEO Mike Jeffries to stand trialDvorak’s epic masterpiece at the PromsGreg Jenner and guests examine the tumultuous events of 1066Most read1AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC2'Nigel hits the jackpot' and 'Dark day for democracy'3Will the Thirlwall report change the debate about Lucy Letby?4Diljit Dosanjh makes history under the famous Wembley arch5They lost their jobs after posting about Charlie Kirk, but some have no regrets6Best friends for decades - until a DNA test revealed they were sisters7Shocked walker finds SUV blocking route on Wales Coast Path 8Tom Felton: I'm so excited to see Rupert Grint play Ron Weasley again9Dramatic insider warnings over AI fall flat with some in Silicon Valley10Student loan terms to be made clearer in EnglandBBC News ServicesOn your mobileOn smart speakersGet news alertsContact BBC NewsHomeNewsSportEarthReelWorklifeTravelCultureFutureMusicTVWeatherSoundsTerms of UseAbout the BBCPrivacy PolicyCookiesAccessibility HelpParental GuidanceContact the BBCCareersBBC emails for youAdvertise with usCopyright © 2026 BBC. The BBC is not responsible for the content of external sites. Read about our approach to external linking.

Dramatic insider warnings regarding the existential risks associated with artificial intelligence have encountered skepticism among some executives and investors in Silicon Valley. This contention arose following public statements by former Anthropic researcher Jacob Coxon, who warned that those building artificial intelligence believed the technology could pose a threat to humanity, stating that these systems would soon be superhuman and capable of hacking anything. Coxon’s assertion that AI development was essentially "gambling with our lives" was met with differing interpretations, contrasting sharply with the prevailing narrative of rapid technological pursuit.

While Coxon’s warnings were explicitly framed as not being marketing material, some figures within the technology sector reacted to the public alarm with doubt, suggesting the statements might be strategically employed to generate hype and secure investor support. Anthropic and OpenAI are reportedly preparing for significant initial public offerings, which has led some critics to accuse the company leadership of prioritizing valuation over genuine safety concerns. Dario Amodei, the head of Anthropic, responded to this climate by calling for a necessary deceleration in AI model development and the implementation of global regulation, acknowledging that the associated risks are serious.

The skepticism extended to prominent figures in the industry. George Arison, CEO of Grindr, characterized Coxon and others' comments as indicative of an "anti-civilisational worldview" at Anthropic, suggesting that the warnings were motivated by a desire to justify high valuations and assert the notion that AI will lead to complete dominion over industry and labor. This sentiment was echoed by other industry observers; for instance, Nvidia’s boss Jensen Huang dismissed the idea that AI would result in the end of humanity as "complete nonsense," while investment firm head Brad Gerstner accused Coxon of exhibiting "ridiculous hyperbole." Clement Delangue, CEO of Hugging Face, put the warnings into perspective by likening the concern to asking a utility provider about climate change, emphasizing the need to maintain balance between innovation speed and safety.

The dispute surrounding these warnings has also touched upon regulatory and governmental considerations. The revelations regarding Anthropic’s work, including the development of tools capable of cybersecurity and the threat models explored, have spurred discussions among legislators about the need for public oversight. This has indirectly fueled potential calls for governmental action, such as the proposed Ban Artificial Superintelligence Act, which seeks to impose a pause on advanced AI development to manage potential catastrophic impacts. The context for such action is complicated by the geopolitical landscape, where concerns exist regarding whether regulations will be driven by domestic political interests or by the need to prevent a potential ceding of dominance to other nations.

Furthermore, the dynamic between the AI companies and political figures remains fraught. The relationship between Anthropic and the US administration has been strained, particularly after the company refused access to its AI models for use by the US military, leading to official designations regarding supply chain risks. This scrutiny contrasts with the position of other entities, such as OpenAI, which has maintained a more cooperative relationship with the administration. In the context of financial pursuits, while there is a focus on potential public share offerings for AI firms, the underlying concerns about profitability and safety continue to be debated among investors who weigh the promised returns against the existential uncertainties raised by the researchers themselves.