Steven Rosenbaum has decided that the real villain behind the bogus quotes in his book is a chatbot. Earlier this week, The New York Times reported that The Future of Truth, Rosenbaum’s much-discussed book about how AI shapes reality, contains more than half a dozen fake or misattributed quotes. Rosenbaum pinned some of them on his use of AI. He claimed responsibility for the errors and said he was investigating what went wrong. By the time I spoke with him on Thursday, though, he was pointing his finger elsewhere. ChatGPT “fucked up the book,” Rosenbaum said.Rosenbaum, a media entrepreneur and the executive director of the Sustainable Media Center, said he came to rely on AI tools as both a resource and a conversation partner while he worked on the book (which he also notes in the book’s acknowledgements). During our conversation, Rosenbaum struggled to reconcile AI’s sometimes staggering capacities with its penchant for head-scratching hallucinations—such as an imaginary quote from the tech journalist Kara Swisher that he included in the book without verifying it. In recent days, he has come to feel “seduced and betrayed” by AI, suggesting at one point that it might have undermined him on purpose. “Depending on your paranoia level, it's either quirky or evil or sneaky,” he said.It’s been a rough week for human authorship all around. On Monday, a viral post showed a Nobel-winning novelist seemingly admitting to using AI to sharpen her story ideas, before later claiming she had been misunderstood. On Tuesday, allegations mounted that the Trinidadian author Jamir Nazir had used AI to write “The Serpent in the Grove,” which won the Commonwealth Short Story Prize. By Wednesday, two of the other five prize winners had come under similar scrutiny. (The Commonwealth Foundation, which administers the prize, initially said in a statement that it had confirmed that none of the winning writers used AI. On Friday, it issued another statement saying it “takes seriously the allegations” and was reviewing the evidence.)[Read: This literary AI scandal changes everything]Since ChatGPT arrived, automated writing has become ubiquitous: A recent working paper estimated that more than half of all new books released on Amazon now contain AI-generated text. Chatbots’ prose has generally been good enough to fool schoolteachers and inflate Amazon product ratings—not to earn glowing blurbs from prominent authors or win literary prizes. Recently, something has changed. As AI tools have improved and gone mainstream, the technology has penetrated intellectual spaces once thought to be fortified against its advances. This spate of scandals is forcing a fresh reckoning over what to do about the crisis.One response has been to call for a redoubling of efforts to root out AI writing and reinforce the stigma against it. If shame won’t stop people from using AI to do the hard work of writing, maybe ridicule will. In Defector, Patrick Redford derided the “pathetic behavior” of writers who use AI. “You idiots!” he wrote. “Those models are the enemy!”Treating any use of AI in serious writing as taboo is understandable. Up until now, it’s been relatively easy to use the hallmarks of AI-generated prose as a proxy for shoddy writing and thinking. Maybe we can keep that up a while longer. As I read The Future of Truth, I ran across an unusual amount of clunky repetition, formulaic transitions, and perplexing passages. One particularly tinny paragraph begins, “As we delve deeper into the mechanisms of misinformation, it’s essential to understand how it not only proliferates but also profits.” I ran the 146-word passage through Pangram, an AI-detection tool that is imperfect but reputed to be less flawed, at least, than some others. It registered the writing as 100 percent AI-generated. When I asked Rosenbaum whether he had let AI write any parts of his book, he said, “Absolutely not.” When I mentioned the Pangram result, he said, “I’m not going to get into that game.”The bigger challenge may be that “AI writing” is not just one thing. There’s a wide spectrum between text that is untouched by machine intelligence and writing that is concocted entirely by a chatbot. At the maximalist end, most of us can agree that a writer wouldn’t deserve a prize for typing, “Write a haunting, 3,000-word literary short story set in Trinidad” into Claude and then slapping his name on whatever it spits out. On the minimalist side, it’s presumably fine for a writer to do some Googling in the process of researching a piece that is otherwise entirely her own. Then again, what they find may still be imbued with AI: Google search is answering more questions directly via chatbot, and the results are turning up more AI-written web pages. Good information comes from primary sources, not synthetic text.Generic chatbots have been joined by purpose-built AI research and writing tools that can carry out complex tasks. A growing number of professional writers, following the lead of software developers, openly profess to incorporating them into their workflows. The tech reporter Alex Heath, for instance, trained a version of Claude Cowork to write in his style and crank out first drafts of his stories, as Wired reported in March. My own use of AI is comparatively primitive but worth disclosing here: In line with The Atlantic’s internal guidelines, I sometimes use chatbots like a slightly smarter thesaurus, to suggest the most apt word to plug into a given sentence, and I occasionally ask them to suggest expert sources on a specific topic. I also use an AI-powered tool to transcribe interviews, backstopped by my own notes.[Read: The human skill that eludes AI]Exactly where to draw the line on acceptable uses of AI is not as obvious as it might seem. In Rosenbaum’s case, the scandal can’t just be that he used AI while working on his book, because he acknowledged that up front. He got in trouble because he used AI badly, failing to check its work on a task at which it is famously unreliable. Or consider that The New York Times, which has endured a spate of AI writing scandals, maintains two different standards. Its freelancers can use AI tools for “high-level brainstorming” and almost nothing else. Newsroom employees are encouraged to experiment with what the paper’s guidelines tout as “a powerful tool that, like many technological advances before it, may be used in service of our mission.” The leading trade group for book authors, the Authors Guild, eschews edicts but warns of the ethical risks of various AI uses.Condoning AI for research but forbidding any use of its prose might be the most intuitive stance. It is certainly the most convenient: We have no reliable way to tell when AI was used to brainstorm ideas, research facts, or help a writer shape the framing of a story. But as the neuroscientist Tim Requarth pointed out in Slate, it is those hidden uses of AI in the writing process that give rise to our most valid concerns. The real threat the technology poses is not the overuse of the word “delve” in academic papers or the profusion of strained metaphors in literary fiction. It’s that we lose something essential when we outsource to machines the hard work of discovering the truth and interpreting the world around us (or, in the case of fiction, the worlds within us). It’s that the biases embedded in language models trained on dubious sources and controlled by tech companies will seep into the narratives that shape our understanding of reality. Are we sure that using AI to turn a phrase is worse than using it to decide what to write about in the first place?If nothing else, the pileup of scandals should force us to think more precisely about what it is we fear from AI writing. If the problem were simply that it’s bad, then its steady improvement would be cause for relief rather than alarm. On the contrary, the problem seems to be that AI tools are getting too good, at least superficially, and that people are placing too much faith in them. Even though Rosenbaum cursed ChatGPT, he told me he couldn’t imagine giving it up. That feeling might pose a greater threat to writing than anything he lays out in his book.