A tool that spots AI-written text measures how something was written, not whether it's true, so can it catch fraud?

This explores whether detecting AI-written text works as a fraud detector for scientific papers. The corpus has no study that tests detectors against real fraudulent manuscripts, so no direct answer exists here. What it does have points to an awkward gap: 'synthetic' and 'fraudulent' are different properties, and the detectors measure only the first one.

The clearest evidence comes from a neighbouring field. Fake news detectors flag truthful LLM-written articles as fake, yet pass human-written disinformation as genuine. They learned to treat a writing style as a sign of deception, and they never checked whether the claims were true Why do fake news detectors flag AI-generated truthful content?. Statistical detection can be very accurate at the style task. Simple, interpretable linguistic features identified LLM-written arguments on Reddit with 99% accuracy, because models leave recognisable habits such as echoing the prompt and textbook-style argument markers Can simple linguistic features detect AI-written arguments?. But a 99% style detector is not a fraud detector. It would flag an honest researcher who polished their prose with an LLM, and it would miss a hand-written paper with fabricated data.

The scale of AI-enabled fraud makes this mismatch worse. One demonstration generated 288 complete finance papers from 96 statistically significant patterns found in data. Each paper came with an invented theory and fabricated citations Can AI generate hundreds of fake academic papers automatically?. The core fraud there is HARKing: finding a result first, then writing a hypothesis as if it had been predicted. That fraud sits in the research process, not the sentences. A style detector could flag these papers for being AI-written, but it cannot tell that the story was made up after the fact. If a human rewrote the text, detection might fail too. One paper argues that heavy rewriting erases stylistic fingerprints, though it never actually tested detectors Do rewrites that hide authorship also fool AI detectors?.

Human judgement doesn't fill the gap. Across 30 studies, people identified AI-generated content at roughly chance level Can people reliably spot content made by AI?. Handing review to an LLM brings its own weakness: LLM judges give higher scores to text that includes fake references and polished formatting, regardless of quality Can LLM judges be fooled by fake credentials and formatting?. Fabricated citations, a hallmark of generated papers, are exactly the kind of authority signal that fools them.

The more promising lead in the corpus is checking claims against evidence instead of asking who wrote the text. In one study, readers with no information about sources could not tell true statements from fluent fabrications. When an interface showed how many claims had been verified, their ability to separate the two returned Can readers tell truth from fabrication without evidence signals?. For manuscripts, that suggests checking whether citations exist, whether the data supports the conclusions, and whether the hypothesis was registered before the results. Asking whether a machine wrote the paper is the wrong question.