When AI makes every cover letter polished, what do employers look at instead to tell who'll actually do good work?
What other signals might employers lean on when letter quality stops predicting fit?
This explores what employers actually turn to once AI writing tools make cover letters easy to polish, and which replacement signals hold up and which are just as easy to fake.
This explores what employers do once a well-written cover letter no longer tells them who will do good work. The best evidence comes from one natural experiment. Freelancer.com gave workers an AI tool that wrote tailored proposals, and the old link between letter quality and getting hired weakened sharply. The link between how well a letter matched the job and whether the worker got a callback fell by about half (Does AI cover letter writing change what employers value?, Does AI-generated cover letter access weaken hiring signals?). Overall hiring held steady, but employers changed what they looked at. They moved to **prior work history and on-platform reputation**: a record of finished jobs that a chatbot can't produce on request.
Why letters stopped working matters for judging what replaces them. A careful letter used to signal ability because it took effort, and able workers found that effort cheaper to spend. AI tools broke that link. Effort no longer tracked quality, and letters stopped predicting whether a job would be completed (Why did AI tools break the effort signal in hiring?). Losing this signal isn't harmless. In a simulation with no written signals at all, top-performing workers got hired 19% less often and the weakest got hired 14% more often (Does cheap writing weaken hiring based on worker ability?). Work history helps, but it can't help newcomers who don't have one yet.
Kessler's proposal splits the replacement signals by job (Can hiring signals survive when AI makes cover letters worthless?). For **quality**, use someone else vouching for you, because a recommender puts their own reputation at stake. That half has evidence behind it: recommendations measurably improved hiring. For **genuine interest**, use something scarce, like an in-person meeting or a networking conversation, since you can only spend your time on a few employers. That half is still untested. There's also a less obvious signal hiding in the click data. Workers who spent more time *editing* their AI drafts were hired more often, even though most people barely edit at all (Does editing time on AI drafts predict hiring success?). The cost has moved from writing to revising, and revision can still carry information.
Some other candidate signals look weaker than they seem. Listing AI skills on a CV raised interview invitations by 8–15 percentage points, but certificates added little over simply claiming the skill. Recruiters are rewarding a claim they don't verify (Do AI skills help candidates get more job interviews?). That makes it the next cheap signal waiting to be gamed. Polish itself also keeps misleading people: evaluators rated AI-written documents as both more human and better than real human submissions (Does polished writing actually signal better quality work?).
The twist is what happens when employers hand screening to AI. LLM evaluators prefer resumes they rewrote themselves, and they do this because of matching style, not better content. The bias gets stronger in larger models (Do language models favor resumes they rewrote themselves?). LLM judges are also easily swayed by authority cues and rich formatting, including fake references (Can LLM judges be fooled by fake credentials and formatting?). So if a machine reads the recommendations and work histories, those signals could be faked in exactly the way letters were. The signals that last are the ones tied to a real person's accountability or a verified record, not to anything that can be produced as text.
Sources 10 notes
After Freelancer.com's AI Bid Writer launched, the correlation between cover letter alignment and callbacks fell 51%, and employers shifted to evaluating prior work histories instead. Overall hiring rates stayed stable, suggesting the market adjusted by using different signals.
On Freelancer.com, when an AI letter generator lowered the cost of writing tailored letters, letter quality became much weaker at predicting interviews and job offers. Employers then relied more on work history and reputation instead.
On Freelancer.com, proposals written with native AI tools show effort inversely correlated with signal quality, and signals no longer predict job completion. Employer willingness to pay for high-signal workers fell sharply after adoption.
A simulation of Freelancer.com hiring without written signals shows top-quintile workers get hired 19% less often, while bottom-quintile workers get hired 14% more often. Employers lose the costly-effort signal that once distinguished able workers.
Kessler proposes replacing cover letters with third-party recommendations (which signal accountability) and in-person meetings or networking (which signal genuine interest through scarcity). Recommendation letters showed measurable hiring benefits, though the interest-signal half remains untested.
Show all 10 sources
Within workers on Freelancer.com, time spent editing AI-generated cover letter drafts is associated with higher hiring success, even though most workers submit drafts with minimal revision. The paper measured this through click timestamps and application submissions.
A conjoint experiment with 1,725 recruiters found AI skills significantly increased interview invitations across occupations, though certificates added only moderate gains over self-declaration, suggesting recruiters reward AI proficiency without verifying actual competence.
Studies show evaluators perceived AI-generated documents as both human-written and better quality than human submissions. This suggests rhetorical polish misleads judgment and should not serve as a quality signal in evaluation.
Across a controlled experiment on 2,245 resumes, eight of nine LLMs preferred their own rewrites over matched human versions when evaluating candidates, with preference rates ranging from 26% to 98%. The bias strengthened in larger models and emerged from stylistic alignment rather than content quality differences.
Research identified four evaluation biases in LLM judges, with authority and beauty biases being semantics-agnostic and trivially exploitable through fake references and formatting—zero-shot attacks requiring no model access or optimization.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- AI Is Killing the Cover Letter
- Signaling in the Age of AI: Evidence from Cover Letters
- AI Skills Improve Job Prospects: Causal Evidence from a Hiring Experiment
- AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
- AI-written admissions essays are widespread but penalized
- Making Talk Cheap: Generative AI and Labor Market Signaling
- LLM or Human? Perceptions of Trust and Information Quality in Research Summaries
- Stranded Credentials: Keeping Online Reputation Systems Informative in the AI Era