VERIFY BEFORE YOU BELIEVE

Do AI Text Detectors Work? What Their Scores Can and Cannot Prove

AI text detectors can sometimes identify statistical patterns associated with generated writing, but their scores are not proof of authorship. False positives and false negatives matter, especially when a score is used to accuse a student, employee or writer.

Reviewed: 20 August 2026•Evidence-led explainer
Abstract editorial illustration for Do AI Text Detectors Work? What Their Scores Can and Cannot Prove
Source, context, provenance and corroboration are stronger than a single visual clue or detector score.
THE SHORT ANSWER

AI text detectors can sometimes identify statistical patterns associated with generated writing, but their scores are not proof of authorship. False positives and false negatives matter, especially when a score is used to accuse a student, employee or writer.

Start with source and context

The question is not simply whether something looks AI-generated. Start with who published it, where it appeared first, what independent evidence supports it and whether provenance information survives from the original file.

AI detectors infer patterns rather than reading a hidden authorship label embedded in ordinary text. That is the anchor for the rest of the check: build confidence from source, context and corroboration rather than trying to force a verdict from one clue.

What matters in practice

AI detectors infer patterns rather than reading a hidden authorship label embedded in ordinary text.

Synthetic media quality keeps improving, while genuine media can look strange after compression, cropping or editing. That makes appearance alone a poor basis for a confident verdict.

Editing, paraphrasing, translation and short samples can change detector outputs substantially.

Provenance can strengthen a conclusion when it is available, but missing provenance is not proof of fakery. Treat it as one piece of evidence alongside the original source and independent corroboration.

Different detectors can disagree on the same passage because they use different models and thresholds.

The consequence of being wrong should set the verification threshold. A harmless meme can tolerate uncertainty; a claim that could move money, damage a reputation or trigger panic deserves a much stronger evidence trail.

Why visual clues are not enough

Verification rarely produces perfect certainty from one clue. Strong conclusions come from several independent pieces of evidence that point the same way, while missing or conflicting evidence should lower confidence.

  • A high detector score does not prove a named person used AI.
  • A low detector score does not prove text was written entirely by a human.

What could change the answer?

Confidence should move when a better source appears, provenance becomes available or genuinely independent reporting confirms or contradicts the claim. A good verification process leaves room for the answer to change.

What you can do now

Slow the claim down. Find the original source, look for context and corroboration, and increase the evidence threshold when being wrong would have serious consequences.

  1. Use detector output only as one signal in a wider review.
  2. Look for drafts, sources, revision history and subject knowledge when authorship genuinely matters.
  3. Avoid disciplinary or reputational decisions based solely on one detector percentage.

A four-question reality check

When a claim sounds dramatic, work through these four questions before deciding how much weight to give it.

1. Capability

What can the system demonstrably do?

2. Access

What tools, credentials and networks can it actually reach?

3. Persistence

Can it keep operating after errors or intervention?

4. Consequence

What real-world outcome follows if safeguards fail?

Bottom line

A good verification process is comfortable with “not enough evidence yet.” That is usually safer than forcing every suspicious image, video or claim into a confident real-or-fake label.

AI text detectors can sometimes identify statistical patterns associated with generated writing, but their scores are not proof of authorship. False positives and false negatives matter, especially when a score is used to accuse a student, employee or writer.

Sources & further reading

These links are selected for the claims and methods discussed above. Primary or official sources are preferred where available.

Two useful questions

What is the biggest caveat?

A high detector score does not prove a named person used AI. A low detector score does not prove text was written entirely by a human.

What is the most useful next step?

Use detector output only as one signal in a wider review. Look for drafts, sources, revision history and subject knowledge when authorship genuinely matters.