INQUIRING LINE

Fake passwords planted to trap hackers work only if the hacker knows less than your team — what happens when they don't?

Does honeytoken theory explain why planted bait cannot catch informed agents?

This explores whether the theory behind honeytokens (fake credentials or files planted so that anyone who touches them sets off an alarm) explains why that bait stops working against an attacker who knows what the defenders know.


This explores whether the theory behind honeytokens (fake credentials or files planted so that anyone who touches them sets off an alarm) explains why that bait stops working against an attacker who knows what the defenders know. The corpus says largely yes, but only under a specific condition. Honeytokens work because of an asymmetry: your own people know how to avoid the bait, and the intruder doesn't. When the attacker shares the same information and the same decision rule as your trusted agents, that asymmetry disappears. If the attacker knows the rule trusted agents use to steer around decoys, they can apply the same rule and walk past the trap. Can honeytokens fool attackers who know the trusted policy? Any rule that keeps your own people safe from the bait also tells the attacker how to avoid it.

The obvious fix is to make the decoys more convincing, but that has a price. The closer decoys look to genuine objects, the smaller the gap between how often legitimate users touch real things and how often the alarm fires falsely. What cost does making decoys convincing impose on legitimate users? Perfect camouflage fools the attacker, but it also makes the bait hard for the people it's meant to protect to work around. The cost falls on the defenders.

The second fix is to hide the decoys by keeping observers isolated, and the theory rules that out too. When agents share what they've seen, a coalition's ability to tell decoys from genuine objects can stay the same or improve but never get worse. Does sharing observations help coalitions detect decoys better? Patience helps the attacker as well. In idealized settings, enough quiet probes that don't trigger anything can separate fakes from real objects with error shrinking toward zero, as long as the two respond differently. Can repeated quiet probes separate decoys from genuine objects? That result assumes independent responses and a known or learnable response pattern, so treat it as a limit case, not a prediction for every real system.

So the theory explains the failure, but "cannot catch informed agents" is too strong. The result is conditional on the attacker sharing information and policy. Restoring the asymmetry means protecting some third thing beyond either. The source paper's conclusion doesn't say what that is. The vault's own guess is either secret information or a rule the attacker can't reproduce. What must honeytokens protect to stay undetectable? Treat that as an open question, not a settled answer.

The same logic shows up in a nearby setting: planting detectable hacks in a task to catch AI agents that cheat on rewards. That makes detection a factual check on a known event instead of an unreliable judgment call. Can planted honeypots reliably catch reward hacking automatically? It works because the agent doesn't know which hacks were planted. The note doesn't test what happens if an agent learns to recognize the plants. Honeytoken theory predicts the trap would weaken in that case, but that is an inference from the theory, not something the corpus has measured.


Sources 6 notes

Can honeytokens fool attackers who know the trusted policy?

Research shows that if an attacker knows the rule trusted agents use to avoid decoys, the attacker can apply the same rule and bypass the trap. Any distinguishing rule that protects legitimate users becomes a roadmap for compromise.

What cost does making decoys convincing impose on legitimate users?

Making decoys look genuine to evade attackers forces a tradeoff: the closer decoys match genuine objects, the smaller the gap between legitimate use rates and false-alarm rates for trusted agents. This bound captures the cost paid by the protected side.

Does sharing observations help coalitions detect decoys better?

Mathematical analysis shows that when agents share their observations, the coalition's capacity to distinguish decoys from genuine objects cannot decrease—it stays the same or improves. This means defenders cannot rely on isolation to hide decoys from coordinated observers.

Can repeated quiet probes separate decoys from genuine objects?

In idealized settings with independent responses, enough quiet probes let a classifier separate decoys from genuine objects with vanishing error if their response distributions differ and are known or learnable from feedback.

What must honeytokens protect to stay undetectable?

Research shows honeytokens fail when attackers have common information and can replicate trusted policies. Restoring asymmetry requires protecting a third element—neither information nor policy—but the paper's conclusion fragment does not specify what. The vault infers it must be either secret information or an unreproducible rule.

Show all 6 sources
Can planted honeypots reliably catch reward hacking automatically?

Embedding detectable hacks into tasks shifts detection from interpreting agent behavior to checking for specific known events. This avoids the unreliability of human or LLM judges by making hacks a factual matter of the environment rather than a post hoc judgment call.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.