Could AI Hallucinations Be The Downfall Of The Pentagon?
The Pentagon is moving to revolutionize its wargaming capabilities with artificial intelligence, opening vulnerabilities to what is being dubbed “AI hallucinations.”
Code Metal, a Boston-based AI firm, received an $80 million contract to implement AI into WarMatrix, the Department of War’s wargaming program, Fortune reported on Friday. Experts warned the Daily Caller News Foundation that implementing AI into military technologies such as wargaming could make the U.S. military a victim of “AI hallucinations,” or falsely generated information.
“Hallucinations are associated with large language models [such as ChatGPT] and refer to outputs that seem plausible, or coherent, but are factually incorrect, inconsistent or outright non-sensical,” professor of political theory at Queen Mary University London Elke Schwarz told the DCNF. “Hallucinations are inevitable, they can perhaps be minimised but never be eradicated.”
As AI hallucinations are “inevitable,” the use of this technology in military applications could have serious consequences. Some analysts have speculated that AI could have been involved in the bombing of an Iranian girls’ school at the onset of the Iran War, which killed 168 children, mostly girls, according to Iranian officials cited by Reuters.
The strike was still under investigation as of March 11, but the U.S. does not deliberately target civilians, Defense Secretary Pete Hegseth told CBS News’ “60 Minutes” in an interview that aired March 8. (Read more from “Could AI Hallucinations Be The Downfall Of The Pentagon?” HERE)
