US Military had close call after using AI for hallucinated intelligence report
Recorded: Sept. 18, 2026, 6:08 p.m.
| Original | Summarized |
Exclusive: US military had close call after using AI for false intelligence report, sources say | CNN Politics Ad Feedback CNN values your feedback 1. How relevant is this ad to you? 2. Did you encounter any technical issues? Video player was slow to load content Video content never loaded Ad froze or did not finish loading Video content did not start after ad Audio on ad was too loud Other issues Ad never loaded Ad prevented/slowed the page from loading Content moved around while ad loaded Ad was repetitive to ads I've seen previously Other issues Cancel Submit Thank You! Your effort and contribution in providing this feedback is much Close Close icon Politics More Elections 2026 Trump Facts First CNN Polls Redistricting Tracker Epstein Files Watch Listen Subscribe Sign in My Account Settings Newsletters Topics you follow Sign out Your CNN account Sign in My Account Settings Newsletters Topics you follow Sign out Your CNN account Listen Watch Edition US International Arabic Español Edition US International Arabic Español Elections 2026 Trump Facts First CNN Polls Redistricting Tracker Epstein Files Follow CNN Politics Download the CNN App US Crime & Justice Immigration Education Transportation Race & Identity World Africa Americas Asia Australia China Europe India Middle East United Kingdom Politics Elections 2026 Trump Facts First CNN Polls Redistricting Tracker Epstein Files Business Tech Media Calculators Videos Markets Pre-markets After-Hours Fear & Greed Investing Health Life, But Better Fitness Food Sleep Mindfulness Relationships CNN Underscored Electronics Fashion Beauty Health & Fitness Home Reviews Deals Money Gifts Travel Outdoors Pets Entertainment Movies Television Celebrity Tech Innovate Style Arts Design Fashion Architecture Luxury Beauty Video Travel Destinations Food & Drink Stay Videos Sports NFL NBA MLB WNBA Golf Soccer Tennis Motorsport College Sports Olympics Bleacher Report Science Space Life Unearthed Climate Solutions Weather Weather Video Climate Ukraine-Russia War Israel-Hamas War Watch Featured Shows & Films Network TV Clips CNN Headlines Shows A-Z CNN 10 CNN TV Schedule Listen All There Is with Anderson Cooper Chasing Life with Dr. Sanjay Gupta The Assignment with Audie Cornish Terms of Service with Clare Duffy CNN 5 Things All CNN Podcasts Games Daily Crossword Jumble Crossword Photo Shuffle Sudoblock Sudoku 5 Things Quiz About CNN Subscribe Photos Investigations CNN Profiles CNN Leadership CNN Newsletters Work for CNN Download the CNN App 5 min read
Exclusive: US military had close call after using AI for false intelligence report, sources say By Katie Bo Lillis, Zachary Cohen Updated Sep 18, 2026, 12:55 PM ET PUBLISHED Sep 18, 2026, 12:55 PM ET
US Army soldiers conduct unmanned aerial system training in April 2026. Spc. Alva Gonzalez/US Army National security AI See all topics Tweet Link Threads Link Copied! Follow The intelligence report, circulated across the US military this spring in the midst of the war with Iran, immediately set off alarm bells: A Chinese ship in the Middle East was transporting components of a nuclear weapons program. The US military swung into action with plans to intercept the vessel, according to four sources familiar with the episode. According to two of the sources, armed members of the US military were preparing to board the ship. Military planes were in the air, one of those sources and another source familiar with the incident said. It was only just before the planned operation that officials dug deeper into the report put together by a special operations command analyst and found it had been generated with the help of artificial intelligence (AI) — and that a chatbot the analyst had used inaccurately identified the material the ship was carrying. CNN was not able to learn what the misidentified cargo was. The report, according to one of the sources, was “entirely false.” But it also “almost started a war,” the source said. Any US operation against a Chinese vessel could have risked spiraling into an armed conflict between the two nations. Across the US military and the intelligence community, officials are pushing to weave AI into nearly every facet of their work, from analyzing the huge volumes of raw intelligence the US collects and selecting targets for strikes, to more mundane applications like managing budgeting, logistics and supply chains. But the episode underscores the profound risks of using this powerful, new and relatively poorly understood technology for targeting in the middle of a war. Analysts have long feared that AI could lead to a catastrophic miscalculation if nation states are relying on poor or corrupted data — the kind of miscalculation that might lead the United States to fire on a Chinese ship based on inaccurate information. In this particular instance, the analyst queried a chatbot about some intelligence reporting on the ship’s manifest that originated with US Special Operations Command Pacific, based in Hawaii. It was not clear whether the chatbot was a commercially available one or a US government product. “The internal tools are mostly just copies of the commercial stuff wearing lipstick,” a former senior US official familiar with the AI systems used by military and intelligence analysts. The bot fused together open-source intelligence with secret signals intelligence in government holdings and reached its fateful conclusion about the material the ship was carrying. The analyst then used AI again to package the findings into a standard intelligence report — the kind that is trusted by military officials — and disseminated it. US Special Operations Command Pacific and the Pentagon did not respond to a request for comment. The rationale for the rapid adoption of AI is that it can help the military make battlefield decisions, like which targets to strike or which military assets to move where, faster. Officials say the US can’t afford to fall behind in integrating AI in case it must one day fight China or another adversary who would potentially be able to stay one step ahead of the US. In January, Defense Secretary Pete Hegseth released his agency’s “Artificial Intelligence Acceleration Strategy” in a bid to speed up the military’s use of AI. “We will unleash experimentation, eliminate bureaucratic barriers, focus our investments and demonstrate the execution approach needed to ensure we lead in military AI,” Hegseth said in a speech announcing the strategy. Secretary of War Pete Hegseth testifies during a Senate Appropriations Committee hearing in the Dirksen Senate Office Building on Capitol Hill on July 21, 2026 in Washington, DC. Anna Moneymaker/Getty Images The strategy also pushes for its broad use across the military, ordering the department to make AI available via several programs with the aim of “democratizing AI experimentation and transformation across the Department by putting America’s world-leading AI models directly in the hands of our three million civilian and military personnel, at all classification levels,” a memo announcing the strategy said. But the effort is decentralized, multiple US officials familiar with the dynamic said, with different parts of the government using different tools under different orders and safety standards. There’s no one set of standards for how the US verifies the information generated by these tools. The constellation of different AI systems being deployed by disparate corners of the military and intelligence community means that the relative reliability and functionality vary widely. For weeks, Washington policymakers have been intensely debating AI after a series of dire warnings from Silicon Valley engineers and tech CEOs of the possibility that AI could break free of human constraints, with potentially civilization-ending consequences. But the episode with the Chinese ship underscores a different, and more immediate risk: human beings making disastrous decisions based on inaccurate or misleading information generated by AI or other automated systems. Sources said that the military is rapidly turning to AI to help with targeting, an area which holds the obvious risk of fatal mistakes. “AI in targeting is definitely something that is ramping up and there is no real guidance for how having a human in the loop will prevent civilian casualties or fratricide,” another source familiar with the military’s current policies said. The kind of “hallucination” that the tool used by the analyst in this case conjured has not been an isolated incident across the intelligence community since these tools began proliferating across government, according to one of the sources. For some older intelligence officials — even those who broadly support the use of AI inside the military — AI has put pressure on analysts to produce and disseminate intelligence faster, opening the door for mistakes. Young analysts in particular, several sources said, are natives on these tools and more likely to trust them uncritically. “AI allows you to get to a bad idea faster,” one of the sources said. National security AI See all topics Tweet Link Threads Link Copied! Follow
Ad Feedback
Paid Content Paid Content Ad Feedback
Subscribe Sign in My Account Settings Newsletters Topics you follow Sign out Your CNN account Listen Watch US Crime & Justice Immigration Education Transportation Race & Identity World Africa Americas Asia Australia China Europe India Middle East United Kingdom Politics Elections 2026 Trump Facts First CNN Polls Redistricting Tracker Epstein Files Business Tech Media Calculators Videos Markets Pre-markets After-Hours Fear & Greed Investing Health Life, But Better Fitness Food Sleep Mindfulness Relationships CNN Underscored Electronics Fashion Beauty Health & Fitness Home Reviews Deals Money Gifts Travel Outdoors Pets Entertainment Movies Television Celebrity Tech Innovate Style Arts Design Fashion Architecture Luxury Beauty Video Travel Destinations Food & Drink Stay News Videos Sports NFL NBA MLB WNBA Golf Soccer Tennis Motorsport College Sports Olympics Bleacher Report Science Space Life Unearthed Climate Solutions Weather Weather Video Climate Ukraine-Russia War Israel-Hamas War Watch Featured Shows & Films Network TV Clips CNN Headlines Shows A-Z CNN 10 CNN TV Schedule Listen All There Is with Anderson Cooper Chasing Life with Dr. Sanjay Gupta The Assignment with Audie Cornish Terms of Service with Clare Duffy CNN 5 Things All CNN Podcasts Games Daily Crossword Jumble Crossword Photo Shuffle Sudoblock Sudoku 5 Things Quiz About CNN Subscribe Photos Investigations CNN Profiles CNN Leadership CNN Newsletters Work for CNN Politics Watch Listen Subscribe Sign in My Account Settings Newsletters Topics you follow Sign out Your CNN account Follow CNN Politics Download the CNN app Download the CNN app Terms of Use Privacy Policy Ad Choices Accessibility & CC About Subscribe Newsletters Transcripts Help Center Sitemap © 2026 Cable News Network. A Warner Bros. Discovery Company. All Rights Reserved. CNN Sans ™ & © 2016 Cable News Network. Download the CNN app Scan the QR code to download the CNN app on Google Play. Download the CNN app Scan the QR code to download the CNN app from the Apple Store. |
The United States military experienced a close call after utilizing artificial intelligence to generate a false intelligence report during the conflict with Iran. This report falsely alleged that a Chinese ship in the Middle East was transporting components of a nuclear weapons program, leading the US military to plan an interception operation involving armed personnel and military aircraft. However, just before the planned operation, officials investigated the report and discovered that it had been generated with the assistance of artificial intelligence, where a chatbot had inaccurately identified the cargo. The report was deemed entirely false, and sources noted that this miscalculation nearly initiated an armed conflict between the United States and China. The incident highlights the profound risks associated with deploying this powerful, yet poorly understood, technology for targeting in wartime scenarios. Officials are actively pushing to integrate AI into nearly every aspect of military operations, ranging from analyzing vast amounts of raw intelligence and selecting strike targets to managing logistics and supply chains. This push is driven by the need to maintain a strategic advantage against adversaries, particularly China. Despite this rapid adoption, analysts have long expressed concern that relying on potentially flawed or corrupted data from AI could lead to catastrophic miscalculations, such as initiating military action based on inaccurate information. The specific failure involved an analyst who queried a chatbot using intelligence reports originating from US Special Operations Command Pacific to determine the ship's manifest. This system reportedly fused open-source intelligence with secret signals intelligence holdings to reach a misleading conclusion. Furthermore, internal sources indicated that the internal tools used by military and intelligence analysts are often derived from commercial products, and there is a lack of standardized protocols for verifying the information generated by these diverse AI systems, meaning their reliability varies widely across different operational sectors. In response to the perceived necessity of integrating AI, Defense Secretary Pete Hegseth released an Artificial Intelligence Acceleration Strategy aimed at speeding up the military’s use of the technology. This strategy calls for unleashing experimentation and eliminating bureaucratic barriers to ensure the US leads in military AI. It seeks to democratize AI experimentation by making advanced models accessible to three million military and civilian personnel at all classification levels. Nevertheless, the decentralized nature of this effort, with different parts of the government using disparate tools under varying safety standards, means that reliability remains inconsistent. The episode underscores a distinct and immediate danger: human decision-makers are susceptible to disastrous outcomes when basing critical operational decisions on misleading information generated by automated systems. Experts point out that the development of AI in targeting lacks adequate guidance on how to implement a human-in-the-loop process to prevent errors like civilian casualties or fratricide. Moreover, the proliferation of these tools has created a psychological dynamic where AI allows analysts to arrive at erroneous conclusions more quickly, posing a significant threat to rigorous, critical analysis. |