Can a shared canvas serve both human and agent memory?
Does representing project state as typed nodes and links—visible to both humans and AI agents—enable better continuity, reuse, and recovery than isolated prompt-response systems or hidden agent memory?
The JarvisHub paper argues that long-horizon creative work needs the agent to work from the whole "evolving project state" rather than from isolated prompt-output pairs. The abstract and introduction list what that state contains: "references, drafts, alternatives, edits, failed attempts, version relations, tool actions, evaluation signals, and human feedback." The discussion then answers "Why should the canvas be treated as an agent workspace?" by representing "prompts, references, candidates, edits, versions, dependencies, and feedback" as "typed and addressable canvas nodes and links," which "turns the canvas into both an external memory and an action space for the agent."
The reasoning is that intermediate materials "are not incidental by-products of creation" but the context that later planning, revision, and evaluation depend on. Prompt-based, chat-based, and node-based systems "only partially support this state" because they "often discard intermediate context, rely on linear conversations, or require manually specified workflows." Putting the state on a shared canvas is meant to fix all three at once. Because "users can inspect and guide the same state that the agent reads and modifies," the agent "can reuse prior artifacts, perform local updates, maintain dependencies, and continue unfinished work without hiding the process in private tool calls or transient chat history." The design choice with the most weight is that the human-facing surface and the agent-facing memory are one object, not a visual layer over a hidden agent state.
This sits close to Do generated analysis UIs really work better than chat?, which also moves work out of a long chat into a structured interface the user can revisit and reuse. The difference is who the structure serves. TaskArtisan's widgets are built for the human analyst, while the canvas here is described as a workspace for both human and agent. It also contrasts with How can GUI agents adapt when software constantly changes?, where memory is a component of the agent's planner. Here memory is placed in a workspace the user can see. And where Do text-based GUI agents actually work in the real world? concerns agents that must read interfaces built for people, the canvas is a surface built for both readers from the start.
The excerpt does not show that any of this works. It gives no evaluation, no comparison against chat or node-based baselines, and no measure of consistency over time or failure recovery. The abstract says closed commercial systems make it "difficult to study how agents represent context, choose tools, revise artifacts, recover from failures, and maintain consistency over time," and the excerpt promises an open harness for that study but ends before any of it is reported. It also does not say how the agent perceives the canvas or how its node and link types are defined. The claims about reuse, local updates, and continuing unfinished work are stated as consequences of the design, not as findings. What follows at that strength is a design argument to weigh: if project state is worth keeping, the choice of where it lives, in private tool calls, chat history, or a shared inspectable structure, decides who can audit and steer the agent.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do standardized protocols improve multi-agent coordination and reliability?- How do agents perceive and traverse typed node-and-link structures on a canvas?
- What evidence shows canvas workspaces recover from failures better than chat baselines?
- Can unified state objects replace switching between decomposition and writing tools?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do generated analysis UIs really work better than chat?
TaskArtisan investigates whether putting a GUI into LLM-assisted analysis workflows improves usability and clarity, and what trade-offs emerge when analysts need to modify or reuse generated interfaces.
also replaces long chat with structured interface, but built for the human analyst rather than shared with the agent
-
How can GUI agents adapt when software constantly changes?
Can desktop automation agents stay current by combining real-time web documentation with learned task patterns and concrete execution memories? This explores how to avoid training obsolescence in open-world software environments.
agent memory inside the planner, versus memory placed in a user-visible workspace
-
Do text-based GUI agents actually work in the real world?
Can language-only agents that rely on HTML or accessibility trees handle actual user interfaces without structured metadata? This matters because deployed systems face visual screenshots, not oracle data.
agents reading human interfaces, versus one surface designed for human and agent together
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents
- Demystifying Agent Skills: Why They Work-Until They Don't
- Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agents
- Towards a Science of Scaling Agent Systems
- From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- Code as Agent Harness
- Real-Time Procedural Learning From Experience for AI Agents
- Why Do Multi-agent LLM Systems Fail?
Original note title
a canvas of typed and addressable nodes and links is both external memory and action space for a creative agent — humans inspect and guide the same state