INQUIRING LINE

Should the type of dependency between two tasks — handoff, shared resource, or waiting in line — determine how you design the system around them?

How does dependency classification relate to system architecture decisions?

This explores whether figuring out what kind of dependency connects two pieces of work (one task feeding another, two tasks competing for the same resource, and so on) should shape how you design a system, including AI and multi-agent systems.


This explores whether naming the kinds of dependencies between pieces of work should drive how a system is built. The clearest anchor in the collection is Malone and Crowston's coordination theory from 1994. It defines coordination as managing dependencies between activities, and argues that once you know which type of dependency you're dealing with (a shared resource, a producer handing off to a consumer, a task that has to wait for another), you can choose a coordination process that fits it instead of improvising one Can we match dependency types to coordination processes?. The surprising part is how broad the claim is. The same reasoning is meant to apply to organizations, software, and biological systems, so architecture becomes a matter of reading the dependencies before choosing the structure.

The collection doesn't have work that applies this classification to LLM systems directly. Several notes still reach the same idea from the AI side without using its vocabulary. The plainest case is splitting multi-step reasoning into a separate 'decomposer' model and a 'solver' model. Doing this beats a single model that does both, partly because planning and execution stop interfering with each other. Better still, the planning skill transfers across domains while the solving skill does not Does separating planning from execution improve reasoning accuracy?. In coordination terms, that's a producer–consumer dependency made visible and given its own seam in the architecture. Once the seam exists, you can see which side generalizes.

The same reasoning shows up in decisions about cost. The argument for small language models in agents rests on sorting subtasks first: most agent work is repetitive, well-defined language work, so the sensible design sends that to cheap small models by default and calls a large model only when needed Can small language models handle most agent tasks?. A related note shows that small models trained with DPO can handle function calling, one of those well-defined subtasks Can small models match large models on function calling?. Here the classification is about task type rather than dependency type, but the move is the same: describe the structure of the work, then assign parts.

There's also a version of the idea inside a single model. One note argues that chain-of-thought exists because transformers have no built-in way to carry evolving state from one step to the next. Each step depends on the one before it, and a feedforward architecture can only handle that by pushing the state into deeper layers until it runs out of depth. Writing reasoning out as tokens is a costly patch for that mismatch Why do transformers need explicit chain-of-thought reasoning?. Recommender research teaches a parallel lesson: building in assumptions that match the problem beats adding depth or capacity What architectural choices actually improve recommender system performance?. Taken together, these notes suggest that when the architecture doesn't match the dependency structure of the work, you pay for it in workarounds.

The collection doesn't yet test Malone and Crowston's taxonomy against modern multi-agent designs, for example by checking whether 'shared resource' dependencies call for different agent topologies than 'sequential handoff' ones. That link is inferred here, not shown. Still, it's a useful lens to bring with you: when you read about a new agent architecture, ask which dependency it was designed to manage.


Sources 6 notes

Can we match dependency types to coordination processes?

Malone and Crowston's 1994 framework defines coordination as managing dependencies between activities and proposes that identifying dependency types enables systematic matching to coordination processes. The definition bridges multiple disciplines by treating coordination as a universal mechanism across human, computational, and biological systems.

Does separating planning from execution improve reasoning accuracy?

Modular architectures with separate decomposer and solver models outperform monolithic LLMs, with decomposition ability transferring across domains while solving ability does not. The separation prevents planning-execution interference and produces more generalizable skills.

Can small language models handle most agent tasks?

SLMs handle the repetitive, well-defined language tasks that constitute most agent work at 10–30× lower cost than LLMs, making heterogeneous architectures (SLMs by default, LLMs selective) the economically rational design pattern.

Can small models match large models on function calling?

Small models fine-tuned via DPO on correct and incorrect function-calling examples from a large teacher model achieve high accuracy on logical and mathematical tasks. DPO's explicit negative examples directly target the rigid output format failures where SFT alone underperforms.

Why do transformers need explicit chain-of-thought reasoning?

Feedforward transformers lack native recurrent state-tracking and must push evolving state deeper into layers, eventually exhausting depth. Explicit chain-of-thought externalizes this state into tokens as a costly patch for a structural deficiency.

Show all 6 sources
What architectural choices actually improve recommender system performance?

Research shows that architectural choices like removing hidden layers, enforcing constraints on self-similarity, and using appropriate likelihood functions deliver better results than deeper or more complex models. This suggests that problem-specific design decisions matter more than raw representational capacity.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.