INQUIRING LINE

When teams build AI prompts together, who ends up controlling which part — and does that blur the line between design and engineering?

How do teams split prompts into distinct functional components during prototyping?

This explores how people building generative AI products together break a single prompt into separate working parts, and what the rest of the corpus says about why those parts behave differently.


This explores how teams prototyping with generative AI split a prompt into distinct parts, and why that split matters. The most direct evidence comes from a study of 39 practitioners across 13 design sessions. Teams kept arriving at the same four-part anatomy: **input context** (the material the model works on), **system instructions** (what it should do and how it should behave), **output constraints** (format, length, tone), and **few-shot examples** (sample input-output pairs) How do teams decompose prompts when collaborating on generative AI?. The more surprising finding concerns who touches what. Designers, engineers and domain experts each gravitated toward different components, so the prompt became a shared workspace that blurs the usual line between design and engineering work.

The four-part split is more than a convenient filing system, because other research shows the parts respond differently when you change them. Prompt compression work found you can shrink prompts up to 20x with little accuracy loss, but only if you protect instructions and questions and cut much harder into the examples Can prompts be compressed without losing model performance?. In practice, the instructions carry most of the weight, and the examples are often padding. A team that has already separated its components knows where it can trim and where it can't.

A second reason to keep the components apart is that problems become easier to diagnose. One framework scores prompt quality on six dimensions, including clarity of communication, cognitive load, instruction design and logic, and finds that fixing one dimension often improves others Can we measure prompt quality independent of model outputs?. Separate components give a team a natural place to apply those checks: a vague output constraint is a different fix from a confusing instruction. There is a caution, though. Even well-separated components are sensitive to exact wording. Prompts that mean the same thing can produce noticeably different output, because models respond to how common a phrasing was in their training data rather than to its meaning Why do semantically identical prompts produce different LLM outputs?. A modular prompt still needs each module tested, and which techniques help also depends on the model tier Do prompt techniques work the same across all LLM tiers?.

The less obvious angle is what decomposition can't fix. One analysis argues that a prompt packs the request, the background context and the model's role into a single fixed frame that the model can't renegotiate the way a human conversation partner would How do prompts reshape the role of context in AI conversation?. Splitting that frame into parts makes the packing visible and editable for the team, but the model still receives it as one block. Iteration has a further side effect. Each round of refinement steers the output toward what the team already expected to see How much does the user shape what a model generates?. So a well-organized prompt can make it easier for a team to confirm its own assumptions. Some designers propose showing a preview of the likely output before a prompt is submitted, which would surface mismatches earlier Can previewing AI output before submission reduce prompt iteration?.

The corpus has limited material here. Only one study looks directly at how teams decompose prompts during prototyping. The rest addresses the same territory from compression, evaluation and interaction design, so treat the four-part model as one well-observed pattern rather than a settled standard.


Sources 8 notes

How do teams decompose prompts when collaborating on generative AI?

Observing 39 practitioners across 13 design sessions, researchers identified a recurring four-part structure: input context, system instructions, output constraints, and few-shot examples. Different roles engaged with each component differently, blurring traditional design-engineering boundaries.

Can prompts be compressed without losing model performance?

LLMLingua achieves up to 20x prompt compression with only 1.5-point performance drops by allocating less compression to instructions and questions, more to demonstrations, then pruning tokens using a small model's perplexity scoring aligned to the target LLM.

Can we measure prompt quality independent of model outputs?

Research identifies six evaluable dimensions—Communication, Cognition, Instruction, Logic, Hallucination, and Responsibility—with 20 sub-criteria based on Grice, cognitive load theory, and instructional design. Improvements in one dimension cascade to others, revealing prompt quality as a structured space rather than a flat checklist.

Why do semantically identical prompts produce different LLM outputs?

Cao et al. and Adam's Law show that semantically identical prompts with different sentence-level frequencies produce systematically different output quality. Higher-frequency phrasings win because models register statistical mass from pre-training, not meaning.

Do prompt techniques work the same across all LLM tiers?

A 23-prompt benchmark across 12 LLMs shows rephrasing and background-knowledge prompts boost cheap models, while step-by-step reasoning reduces accuracy in high-performance models. Task structure, not generic best practices, determines which prompts help.

Show all 8 sources
How do prompts reshape the role of context in AI conversation?

LLM prompts bundle utterance, context assignment, and role specification into a single static frame the model cannot renegotiate, unlike human dialogue where context evolves cooperatively. This makes mid-conversation pivots require explicit re-prompting rather than implicit adjustment.

How much does the user shape what a model generates?

Foundation Priors research shows prompt engineering as divergence minimization between synthetic output and user priors. The refinement process systematically steers generation toward what users already expect, making outputs co-productions of model and user subjectivity.

Can previewing AI output before submission reduce prompt iteration?

A preprint proposes that GenAI systems need feedforward design—showing anticipated output before prompt submission—to bridge the gulf between user intent and model response. Four key properties (anticipation, disambiguation, direct engagement, reflection) and a detailed LLM UI example demonstrate how live previews can surface misalignments and reduce excessive conversational exchanges.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.