Scientists say their studies are reproducible, but can another lab actually run the same experiment from the paper alone?
Can researchers from different labs actually run each other's protocols?
This explores whether one lab can pick up another lab's experimental protocol (the recipe for running a study) and run it, rather than whether software 'protocols' like MCP interoperate.
This reads the question as whether one lab can pick up another lab's experimental recipe and run it. The corpus has one direct answer, and it says the barrier is being lowered, not that anyone has shown it cleared. Pairit, a tool for live human-AI experiments, targets the problem directly. Can declaring experiments in code make them reproducible?
The usual obstacle is that a live human-AI study runs on custom software, and the paper only describes it in prose. A methods section can't be executed. Pairit replaces the prose with one YAML file that spells out who the participants are, what role each AI plays, how messages get routed, and when things happen. That file can be audited, varied, and handed to another lab. The note describes this as making reproduction possible. It doesn't report a second lab actually running someone else's file, so the cross-lab claim is a design promise, not a tested result.
The agent-systems notes show how portability tends to work out. A survey of nine agent communication protocols finds a trilemma: rigid-schema protocols are efficient and portable but not versatile, and flexible ones are versatile but pay in negotiation overhead. Can agent protocols be efficient, versatile, and portable simultaneously? A declarative experiment file looks like the rigid-schema kind. It travels well because it only says what its schema can express. My inference is that a study needing something the schema can't express falls back to custom code, and that's where cross-lab handoff would break.
Two adoption findings point the same way. Coordination standards spread by wrapping the protocols people already use, not by replacing them. Should coordination protocols wrap existing systems or replace them? And in a survey of 306 practitioners, 85% of production teams build custom agents and skip shared frameworks, after protocol-mediated tool access proved non-deterministic. Why do protocol-based tool integrations fail in production workflows? These come from engineering teams, not academic labs, so they are analogies and not evidence about research culture. Still, they suggest a shared experiment format only spreads if it fits what labs already do. Until someone reports a real handoff between labs, nothing in this collection can say whether that happens.
Sources 4 notes
Pairit converts custom software work into declarative YAML graphs that specify participants, AI roles, routing, and timing in one auditable file. This replaces prose methods and allows researchers to vary protocols and hand them to other labs for reproduction.
A taxonomy of nine protocols reveals that rigid-schema protocols like MCP maximize efficiency and portability but sacrifice versatility, while evolving-schema protocols buy versatility at the cost of negotiation overhead. No protocol achieves all three.
Research shows that agent coordination standards achieve adoption by composing existing protocols like MCP and DIDComm under a shared substrate, rather than competing to replace them. Bridging lets value accrue incrementally without forcing ecosystem-wide rewrites.
MCP integration caused non-deterministic failures through ambiguous tool selection and parameter inference. Replacing it with explicit direct function calls and single-tool-per-agent design restored determinism. A 306-practitioner survey confirms 85% of production teams build custom agents, forgoing frameworks.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- A Technical Taxonomy of LLM Agent Communication Protocols
- Towards a Science of Scaling Agent Systems
- A Comparative Study of MCP and A2A for Inter-Agent Coordination in LLM-Based Systems
- A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflows
- A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
- Pairit: A Platform for Live Experiments on Human-AI Collaboration
- LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries
- Foundation Protocol: A Coordination Layer for Agentic Society