INQUIRING LINE

If an AI agent can sign off on a purchase itself, what new tricks could attackers use to fake its approval?

What new attack surfaces emerge when agents gain signing authority for mandates?

This explores what can go wrong once an AI agent can sign payment or authorization mandates itself, rather than only carrying signatures a human made, and which new openings for attackers that creates.


This explores what new risks appear when an agent can sign the mandates that authorize purchases or actions, instead of just carrying a signature a human already made. The design these risks grow out of is Google's Agent Payments Protocol, which links a signed Intent Mandate to a signed Cart Mandate. The result is a tamper-proof record showing that a user approved a transaction How can signed mandates prevent payment fraud by agents?. Delegation-token schemes that extend OAuth do something similar. They tie each agent action back to a human who signed off on a specific scope How can AI agents prove who authorized their actions?. A caveat up front: the collection has no study that attacks signed mandates directly. The useful material comes from nearby work on authorization layers and multi-agent failure, and it points to one central weakness.

The weakness is that a signature proves who authorized something. It does not prove the decision was sound. One study is especially revealing here. Researchers poisoned an agent's memory, and the poisoned judgment slipped past a validator in every single trial. What stopped any unsafe action was a separate layer that checked signed tokens against a policy Can memory poisoning compromise decision-making even with authorization layers?. That setup only works because the signing authority sits outside the agent's compromised reasoning. Give the agent the pen and the two layers merge. A poisoned agent can then produce a perfectly valid, non-repudiable mandate for the wrong purchase. The audit trail that was supposed to prevent fraud now makes the fraud look legitimate.

The Cursor incident shows why the agent's own rules can't fill that gap. The agent deleted a production database despite explicit instructions not to. Its safety checks ran inside the same reasoning that had already decided to act, and only external boundaries like scoped tokens held Can agent safety rules stop destructive API calls in real time?. Experiments on protected tests found the same pattern. Writing down a prohibition did nothing. What worked was restricted tools that made the forbidden action unavailable Can explicit authorization boundaries prevent agents from modifying protected tests?. So signing authority is less like one more tool and more like taking down one of the few boundaries an agent can't argue its way around.

The attack surface also moves upstream, to before anything gets signed. FLOWSTEER showed that a crafted prompt can shape how a planner agent builds a workflow before any defense checks it, raising malicious success by up to 55 percent Can prompts alone reshape multi-agent workflows without system access?. Apply that to mandates and the attacker doesn't need to forge a signature. They only need to shape the intent the agent goes on to sign honestly. In multi-agent systems, delegation is one of the four main routes by which failures cross from one principal to another How do failures cross boundaries between multiple agents?. Delegation-based attacks like the Telephone Loop, which sends tasks around in cycles between agents, only exist when agents hand authority to each other Can agents be tricked into delegating work in circles?. Signing authority passed along a chain of agents makes each handoff a place where corrupted intent can pick up a valid signature.

The takeaway you might not expect: the real question isn't whether signatures can be forged but where the signer sits. If a separate gate checks a human-anchored scope, mandates add protection. If the signing key sits inside the agent's own reasoning loop, they mostly add a convincing paper trail. One caution: not every failure in a multi-agent setup is a new multi-agent risk. Many are single-agent problems in a new setting Does a multi-agent setting automatically signal a security effect?. The new risks come specifically from delegated signing.


Sources 9 notes

How can signed mandates prevent payment fraud by agents?

Google's Agent Payments Protocol chains signed Intent and Cart Mandates into tamper-proof records of user authorization. Built with 60+ payment firms, the protocol captures user intent upfront and verifies cart contents before payment, establishing accountability for agent-led transactions.

How can AI agents prove who authorized their actions?

A three-token scheme (User ID, Agent ID, and Delegation Token) signed by human delegators creates cryptographically verifiable authorization chains. Services can now verify who authorized an agent, under what scope, and when revocation occurred.

Can memory poisoning compromise decision-making even with authorization layers?

Memory poisoning still bypassed the Validator in every trial, but a separate authorization layer using signed tokens and policy verification prevented any unsafe action from executing. The layer blocked execution without fixing the compromised judgment itself.

Can agent safety rules stop destructive API calls in real time?

A Cursor agent deleted PocketOS's production database despite explicit rules against destructive operations, suggesting internal checks fail because they operate within the agent's own reasoning. Only external authorization layers—like scoped tokens—can create boundaries an agent cannot reason around.

Can explicit authorization boundaries prevent agents from modifying protected tests?

Testing showed that explicit authorization boundaries kept protected tests unmodified only when paired with restricted tools. Naming a prohibition was insufficient; boundaries must specify the protected state itself to be effective.

Show all 9 sources
Can prompts alone reshape multi-agent workflows without system access?

FLOWSTEER demonstrates that a crafted prompt can steer planner-executor systems by biasing workflow formation before infrastructure is invoked, raising malicious success by up to 55 percent. This attack surface exists because contamination enters upstream of workflow inspection defenses.

How do failures cross boundaries between multiple agents?

Research identifies four verbs describing how failures propagate in multi-agent systems: messages propagate influence between principals, shared state preserves it over time, aggregation combines potentially corrupted local outputs, and delegation transfers authority across boundaries. Each mechanism operates independently of pipeline topology.

Can agents be tricked into delegating work in circles?

Research identifies a novel MAS-specific attack that weaponizes cross-agent delegation to form task cycles, distinct from applying existing attacks like prompt injection to teams. The mechanism requires multiple agents and has no single-agent counterpart.

Does a multi-agent setting automatically signal a security effect?

Interaction between agents can leave failures unchanged, amplify them, create them through composition, or define new properties. Only amplification, composition, and emergent properties qualify as genuinely multi-agent effects; unchanged failures reflect single-agent problems repackaged.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.