SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems

Paper · arXiv 2607.25255 · Published July 28, 2026
Multi-Agent Architectures

Multi-agent systems improve capability through task decomposition and role specialization, but these same mechanisms introduce an important safety blind spot: a harmful objective can be fragmented into locally plausible subtasks, allowing malicious intent to evade detection by any single agent. This is a growing social-impact challenge: systems handling sensitive information or consequential tools can turn routine delegation into unauthorized disclosure or unsafe action. We argue that this failure mode is better understood as a semantic information-flow problem than as a single-turn prompt classification task. To address this, we propose SafeFlow, a defense framework for multi-agent systems that formalizes malicious cross-agent propagation as a semantic informationflow problem. SafeFlow attaches structured semantic taints to root requests, propagates them through a dynamic collaboration graph, and performs workflow-level validation to reconstruct the global risk context before irreversible actions are committed.

Introduction. Multi-agent systems increasingly coordinate language models as planners (Yao et al. 2023), tool users (Schick et al. 2023), and role-specialized collaborators (Wu et al. 2023; Hong et al. 2024; Li et al. 2023), with increasingly capable frontier models further accelerating this shift (OpenAI 2023). This creates an insufficiently addressed social safety-andprivacy challenge: planner decisions, inter-agent messages, and tool-side effects jointly determine system behavior. Failures involving sensitive information or consequential tools can affect people and organizations that neither authored the prompt nor observe the resulting workflow. In these systems, harmful behavior often emerges compositionally. A malicious objective can fragment into locally plausible subtasks: one agent retrieves sensitive content, another rewrites it, and a third transmits it, such that no individual step looks overtly malicious, yet the composed workflow realizes exfiltration or policy override.

Lines of inquiry this paper opens 24

Research framings built by reading the notes related to this paper — the questions it feeds into.

How do standardized protocols improve coordination in multi-agent systems? What coordination failures limit multi-agent LLM systems as they scale? How should agents balance memory condensation to optimize context efficiency? What makes AI persuasion effective and how can we counter it? Can debate mechanisms prevent silent agreement on wrong answers in multi-agent reasoning? Why do agents confidently report success despite actually failing tasks? How do multi-agent systems achieve genuine cooperation and reasoning? What factors beyond surface content determine how readers extract meaning differently? What structural factors drive popularity bias in recommendation systems? How do adversarial and manipulative prompts attack reasoning models? How should human oversight be integrated with autonomous AI systems? How can AI agents autonomously learn and transfer skills across tasks? Can AI systems develop genuine social understanding without embodiment?