Opus 5.5 loves to tell you âthis mattersâ (and other AI writing tells)
Now that LLM-generated prose is everywhere, human beings are eager for ways to sniff it out. While early tells like em-dashes and âdelveâ are long gone, researchers say there are still plenty of telltale habits that AI models fall back on when writing prose. A new studyfrom the marketing firm Graphite looked at the writing habits of frontier models, sussing out each modelâs favorite words and phrases. While old tells like em-dash use have been stamped out, models still fall back on contrast-heavy constructions, with each model version showing its own unique quirks. The biggest surprise is how broad the scope of tells turns out to be. Graphite found 13,000 phrases that were at least twice as common in the AI content as human content â their definition of a âtell.â âIt turns out that Claude models are actually getting closer to the human word distribution over time,â Graphiteâs chief AI officer Greg Druck told TechCrunch. âAnd for the GPT models, itâs getting further away.â Studying AI-generated writing at scale required a careful study design. Graphite started with a corpus of 10,000 articles published before the release of ChatGPT, serving as the human-generated control group. Then researchers had different AI models rewrite the articles from summaries, hoping to eliminate as much source bias as possible. With matching samples from both humans and each model, they could compare how often certain words and phrases appeared in AI writing, as well as broader patterns in sentence construction. According to Graphiteâs results, Claude Opus 5.5âs biggest tell is the word âdependable,â which pops up 23 times more often than in human samples. While Opus 5.5 now avoidsthe âitâs not X, itâs Yâ sentence construction, it still tends to say something âis more than an X, itâs a Y.â Above all, Opus loves to tell you why things matter, using the phrase âthis mattersâ 116 times more often than human writing, while âwhy X mattersâ occurs 92 times more often. OpenAIâs Astra has a different set of tip-offs. This model loves to describe âanother dimensionâ of whatever itâs talking about, and tends to hedge claims by saying an action âmay provideâ or âcan provideâ a particular benefit. Its biggest tell is what Graphite calls the âcorrective framing,â where a topic is defined as ânot simply Xâ or offered as an alternative, ârather than relying on X.â According to graphiteâs research, those constructions were more than 100 times more common in Astra-generated prose than in human writing. Notably, all the frontier labs seem to have responded to the idea that models overuse em-dashes. In Graphiteâs samples, Opus 5.5 used the punctuation mark 99% less often than Opus 5. Astra now uses it 88% less than human samples, whereas Gemini 3.1 Pro has almost completely eliminated the em-dash from its writing. But while individual tells change, Graphite says the overall number is mostly holding steady. âItâs not like the tells are decreasing,â Druck told TechCrunch. âThey are managing to remove the most well-known tells, but other ones pop up. And every model version has its own.â Itâs surprising that tells are so persistent, given the labsâ focus on human-like writing styles.In the Opus 5.5 release, Anthropic boasted that the model âcommunicates more naturally than prior models,â saying early users âfound its writing clearer and easier to follow.â OpenAI made similar claims when releasingthe GPT-6 versions of Sol and Luna, saying users could âexpect to see more clarity, less jargon, [and] fewer odd turns of phrase.â But Druck is skeptical about how much the labs can do to completely eliminate telltale construction or phrases. âA general hypothesis I have is that the labs are less able to control some of these things than you might expect,â Druck says. âThese are giant models with billions of parameters. They have some finite number of tests they can run, and things slip through.â
