SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
Multi-agent systems improve capability through task decomposition and role specialization, but these same mechanisms introduce an important safety blind spot: a harmful objective can be fragmented into locally plausible subtasks, allowing malicious intent to evade detection by any single agent. This is a growing social-impact challenge: systems handling sensitive information or consequential tools can turn routine delegation into unauthorized disclosure or unsafe action. We argue that this failure mode is better understood as a semantic information-flow problem than as a single-turn prompt classification task. To address this, we propose SafeFlow, a defense framework for multi-agent systems that formalizes malicious cross-agent propagation as a semantic informationflow problem. SafeFlow attaches structured semantic taints to root requests, propagates them through a dynamic collaboration graph, and performs workflow-level validation to reconstruct the global risk context before irreversible actions are committed.
Introduction. Multi-agent systems increasingly coordinate language models as planners (Yao et al. 2023), tool users (Schick et al. 2023), and role-specialized collaborators (Wu et al. 2023; Hong et al. 2024; Li et al. 2023), with increasingly capable frontier models further accelerating this shift (OpenAI 2023). This creates an insufficiently addressed social safety-andprivacy challenge: planner decisions, inter-agent messages, and tool-side effects jointly determine system behavior. Failures involving sensitive information or consequential tools can affect people and organizations that neither authored the prompt nor observe the resulting workflow. In these systems, harmful behavior often emerges compositionally. A malicious objective can fragment into locally plausible subtasks: one agent retrieves sensitive content, another rewrites it, and a third transmits it, such that no individual step looks overtly malicious, yet the composed workflow realizes exfiltration or policy override.
Lines of inquiry this paper opens 24
Research framings built by reading the notes related to this paper — the questions it feeds into.
How do standardized protocols improve coordination in multi-agent systems? What coordination failures limit multi-agent LLM systems as they scale?- What distinguishes task failure from communication breakdown in multi-agent systems?
- How does distributed coordination fail as agent networks scale?
- How do single-agent safety evaluations underestimate risks in deployed multi-agent systems?
- Can single-agent defenses prevent cascading failures in multi-agent systems?
- What makes attribution errors uniquely harmful in organizational group dynamics?
- Can architectural changes like adversarial agent roles prevent silent agreement?
- What specific failure modes occur when downstream agents receive too much upstream input?
- How do delayed effects complicate causal attribution in agent systems?
- How does collaboration topology choice affect error amplification in multi-agent systems?
- How do multi-agent routers balance flexibility against interpretability in design?
- How does component-level self-evolution prevent information loss in multi-agent trajectories?
- Can ordinary agent-to-agent messages carry hidden behavioral signals?
- Can influence estimation identify the most valuable trajectories in agentic training?
- What distinguishes flow-preserving measurement from cognitive vulnerability profiling?
- How does semantic framing differ from content injection attacks?