How readers spot AI writing: the structural tells

A study of 13,500 company blog posts found that AI drafts share a few habits of shape, and that human posts carry things AI drafts don’t have. Word lists catch less, and they expire with each model release.

IntactVoice research team

Sources checked Oct 4, 2026

Published
Updated
Reading time
6 min
On this page
  1. Four habits with the widest gaps
  2. What human posts have that AI drafts lack
  3. Phrase habits are real, and they expire
  4. Who notices
  5. A checklist before you publish
  6. Limits of this evidence
  7. Try it on one post
  8. Sources

In September 2026 a preprint called SlopShape compared 2,250 company blog posts written before ChatGPT with 11,250 posts that five AI models wrote from short briefs on the same topics. Using the structure of each post alone, with no word lists, its classifier told the two apart at 97.0 macro-F1, and at 96.1 after the models reworded their own posts. The habits doing most of that work are ones an editor can see without any software.

Four habits with the widest gaps

Sitefire, the company behind SlopShape, published how often each habit showed up in AI posts and in human posts:

Figure

How often each habit appears

Share of 2,250 human and 11,250 AI company blog posts showing the habit

  • AI posts
  • Human posts

The close restates the opening claim

77%
12%

A summary or synthesis stage

88%
27%

No way for the reader to take part

97%
38%

Thesis announced before the first section

93%
51%

Old-way-versus-new-way framing

76%
26%
Source: Sitefire, Sep 4, 2026, reporting SlopShape (arXiv 2609.15369).
Show as table
HabitAI postsHuman postsWhat to do instead
The close restates the opening claim77%12%End on a status, a caveat or a next step
A summary or “key takeaways” stage88%27%Delete it. The reader just read the post
No way for the reader to take part97%38%One real next step: a link, a tool, a question only your readers can answer
The thesis is announced before the first section93%51%Open with the first real thing: a number, a case, the problem
Share of posts showing each habit. Rates from Sitefire’s blog post of September 4, 2026, which reports the paper’s second version; the gaps match version 3.

All four come from one habit: the post makes its point three times, in the roadmap, in the summary and in the close. A clear thesis is often good writing. Stating it three times is the template.

Two more habits run against popular advice. AI posts framed the topic as an old way against a new way in 76% of cases, against 26% for human posts. And Sitefire reports AI posts escalating the stakes in 88% of cases against 52% (a figure from the earlier version of the paper). Adding a “the old way is broken” contrast to sound more human moves a post toward the AI default.

What human posts have that AI drafts lack

The paper also lists the features that mark human posts. Most are things a model writing from a 120-word brief couldn’t have:

  • things to use: templates, checklists, calculators, code, links,
  • a piece of standard advice the author says is wrong,
  • the reader’s situation, described back to them,
  • named outside people and sources, with clear attribution,
  • comparisons between real options,
  • claims from the author’s own work: “we tested”, “since 2016”,
  • real dates and periods.

We think this is the most useful part of the research for anyone who edits. The tells are mostly absences. A post with a number from your own work, a named type of customer, a date and a link reads differently before anyone touches a sentence. Our guide on why AI content converges goes into where that material comes from.

Phrase habits are real, and they expire

Word-level tells have been measured:

  • “delves” appeared at 28 times its expected rate in 2024 PubMed abstracts (Kobak et al., Science Advances 2025).
  • GPT-4o uses present participial clauses, the “, highlighting the need for…” kind, at 5.3 times the human rate (Reinhart et al., PNAS 2025).
  • In Graphite’s September 2026 study, “the _ is not simply” ran at 576 times the human rate and “matters because” at over 130 times.

They’re also the weakest signal to lean on. In Graphite’s data, between the two latest versions of each model family 55% to 72% of the tells were new, and the combined rate of nine well-known tells fell 41% to 86% from the earliest to the latest model in each family. People pick the words up as well: a preregistered study found people adopt chatbot vocabulary after brief exposure (Yakura et al.). One “delve” tells you very little. A paragraph where three or four stock phrases cluster tells you more.

Em dashes show how fast this moves. Graphite measured the newest GPT model using them 88% below the old human rate. Some readers still treat them as a sign, so follow your own habit and don’t build a check around them.

Who notices

People who use AI tools heavily for their own writing are the strongest judges measured so far. In Russell, Karpinska and Iyyer (ACL 2025), a majority vote of five such readers misclassified only 1 of 300 articles, including articles that had been paraphrased or run through a humanizer. Their written explanations leaned on vocabulary, and also on formality, originality and clarity: the same mix of absence and habit described above.

Platforms now give readers a button for it. LinkedIn added a “seems like AI slop” report option on July 30, 2026 (TechCrunch). LinkedIn later said content its own classifiers label as slop gets about 40% fewer views; the company told Moneywise that figure comes from the classifiers, not from the button. On Substack, readers have been able to run a Pangram AI scan on posts longer than 100 words since July 21, 2026 (Mashable).

A checklist before you publish

Checklist8 checks

  • Read the first paragraph and the last together. If the last one says the same thing, cut it and end on what happens next: a status, a caveat, a step.
  • Search the draft for “In this post”, “we’ll cover”, “Key takeaways”, “Final thoughts” and “In conclusion”. Delete those paragraphs.
  • Find one sentence only your team could have written: a number from your own work, a type of customer, a date, a mistake. If there isn’t one, the draft needs material before it needs editing.
  • List what the reader can use: a link, a template, a search term, a price, a command. If the list is empty, the post is commentary.
  • Check every old-way-versus-new-way contrast and every paragraph that raises the stakes. Keep them only if they’re true.
  • Look for clusters of stock phrases, three or more in a paragraph. Ignore single words.
  • Name your sources. “Studies show” reads as filler; “Kobak et al., 2025” doesn’t.
  • End with something the reader can do that fits this post.

Limits of this evidence

  • SlopShape is a single-author preprint, not peer reviewed, from a company that sells an AI-content checker.
  • Its human posts are company blog posts from 2008 to 2022. Its AI posts are single drafts from a 120-word brief with no editing. Nobody has tested these features on LinkedIn or X posts, on human writing from after 2023, or on drafts a person wrote with AI help.
  • Between 12% and 52% of human posts show each “AI” habit, and the structural classifier called about 7% of human test posts AI.
  • Version 3 of the paper (September 28, 2026) withdrew eleven features that were reacting to formatting, including the most quoted tip, that AI titles “promise the payoff”. That tip no longer has support from this study.

The table describes the default template. Depart from it on purpose, where it helps your reader.

Try it on one post

Open the last post your team published and read its first and last paragraphs side by side. Then run the checklist and count what it fails. Fix the close first: it’s the cheapest change, and at 77% against 12% it’s the habit with the widest gap in the data.

Sources

Dates are each source's publication or last-updated date, or the day we read it.

  1. 1
    SlopShape: identifying AI-generated commercial web content, v3

    arXiv 2609.15369 · Sep 28, 2026

    Jochen Madler (Sitefire)

  2. 2
    How to tell AI slop from human writing

    Sitefire · Sep 4, 2026

    Rates based on the paper’s second version

  3. 3
  4. 4
  5. 5
    AI Tells

    Graphite · Sep 16, 2026

    Vendor study, one fixed prompt

  6. 6
  7. 7
  8. 8
  9. 9
  10. 10

Rewrite with your facts locked.

IntactVoice moves a draft toward a writer's own habits and checks every number, unit, name and link against the source. Plans are billed by the word.