Anthropic refused to let Claude be used for autonomous weapons, prompting the Trump administration to ban it from government use. Downloads rose as consumers backed its ethics. This has given rise to debates over whether AI is truly reliable enough for military use, as concerns rise that chatbots like Claude and ChatGPT make too many mistakes and are not ready for high-stakes acts of war.