AI Error Nearly Sparked US Military Strike on Chinese Vessel

A fabricated intelligence assessment, generated in part by an artificial intelligence tool, nearly caused the United States military to intercept a Chinese vessel in the Middle East. According to CNN, the near-miss event brought the two nations close to an active conflict, underscoring the dangers of relying on automated systems for high-stakes military decisions.

The incident originated when a special operations command analyst queried a chatbot about the cargo manifest of the Chinese ship. The AI tool synthesized open-source data with classified signals intelligence, generating a false conclusion that the boat carried parts for a nuclear weapons program.

Military officials very nearly moved to seize the vessel based on the computer-generated assessment. The operation was halted only after personnel discovered that the intelligence report originated from an AI model rather than verified human analysis.

Unclear Details and Expanding Military AI Partnerships

Reporting from CNN indicates that the exact nature of the ship's actual cargo remains unknown. It is also unclear which specific software application the analyst utilized, as the military has access to various commercial and custom-built tools.

The Department of Defense has increasingly pursued artificial intelligence integration across its operations. In January, a directive from Secretary of Defense Pete Hegseth urged the agency to adopt an AI-first approach and test technology from major domestic software firms.

This push has resulted in multiple high-profile agreements despite occasional friction. Anthropic previously barred the military from using its models for autonomous weapons development, resulting in a temporary government ban. Other technology companies have successfully secured lucrative defense contracts.

Risks and Future Outlook

Corporate partnerships with the defense sector continue to expand. In February, reports emerged that SpaceXAI agreed to provide the military with access to Grok. Furthermore, major firms including Microsoft, Amazon, and NVIDIA established partnerships in May to supply their AI products to the Pentagon.

These commercial deals offer substantial financial rewards for technology providers, driving widespread industry interest. However, the recent close call in the Middle East demonstrates that deploying automated systems in defense environments carries hazards far beyond standard enterprise software implementations.

Engadget reached out to the Department of Defense for comment regarding the incident described by CNN. Further updates will be provided should the agency respond.