Could the bare record of who co-wrote with whom reveal a scientist's expertise, without asking how they think?
How do co-authorship patterns alone capture scientist expertise without surveying reasoning?
This explores how a model can infer what scientists know, and what they are likely to discover next, just from the record of who has published with whom on which topics, without asking anyone how they reason.
This explores how the bare record of who wrote papers with whom, and on what, can stand in for a scientist's expertise without anyone being asked how they think. The clearest example in the collection is the human-aware hypergraph work Can predicting scientists improve discovery forecasts?. It links papers, materials and authors into one network, then runs random walks across it. A walk that goes from a material to an author who studied it, then to a co-author, then to another material they worked on, roughly traces how an idea could actually reach someone. The model never learns what anyone believes. It learns who is in a position to notice a connection. That alone predicted discoveries 43% more precisely than models that read only paper content, and the biggest gains came where the literature was thin.
The surprising part is why this works. Expertise is not only knowledge in someone's head. It is also a position in a social network: whom you talk to, what you have handled, which lab's methods you picked up. Another note makes the reverse argument about language models Can language models distinguish expert arguments from common assumptions?. LLMs read text cut off from reputation and track record, so they cannot tell an expert's claim from a common assumption. Put the two notes side by side and you see that the collaboration graph holds exactly the social context that text-only models lose. Who-worked-with-whom is a compressed record of standing and access.
Community behavior can stand in for judgment in other ways too. One project trained models on 700,000 citation-matched paper pairs to learn 'scientific taste' Can models learn what makes research worth doing?. It never asked researchers why a paper matters. It treated the field's collective citations as the signal. The same logic in reverse explains why fine-tuned LLMs beat neuroscientists at predicting which experimental results really happened Can LLMs predict novel scientific results better than experts?. Patterns across many papers can capture regularities that no single expert puts into words.
This approach has a cost that is easy to miss. If AI tools change who works with whom, the graph these models rely on changes too. AI-augmented researchers publish three times as many papers, yet collaboration across the field fell 22% and the range of topics shrank Does AI help individual scientists while narrowing scientific focus?. A model that reads expertise from co-authorship would see a narrower, more concentrated map of expertise. That map might be accurate, but it would describe a field that is exploring less. Compare this with writing expertise down directly: building expert rules into an agent's scaffolding Can codified expertise let non-experts match specialist output? captures the 'how' that co-authorship graphs skip. That is costly to do, but it is explicit.
A plain caveat: only the hypergraph study in this collection models expertise directly from collaboration structure. The other notes come at the question from the side, through citations, social authority and shifts in collaboration. So the collection supports 'it works, and here is why it might' more than a detailed account of what co-authorship graphs miss.
Sources 6 notes
Random walks over hypergraphs of papers, materials, and authors forecast discoveries 43% more precisely than content-only models, especially when literature is sparse. The mechanism simulates plausible scientific inference steps like collaboration and material expertise.
LLMs lose the social context that gives expert claims their force—reputation, track record, and standing—because they process only text, not the social world where expertise is built and evaluated.
Reinforcement learning trained on 700K citation-matched paper pairs successfully teaches models to predict research impact better than GPT-5.2 and generate higher-impact research ideas. Scientific taste emerges as a community-aligned capability distinct from execution skills.
BrainBench benchmarks show fine-tuned LLMs outperform neuroscience experts at predicting which experimental results actually occurred. The same pattern-integration tendency that causes hallucination in retrieval tasks enables genuine prediction in forward-looking scenarios.
AI-augmented researchers publish 3× more papers and receive 4.8× more citations, but collective science shrinks topic coverage by 4.63% and researcher collaboration by 22%. AI concentrates work on data-rich problems rather than exploring new questions.
Show all 6 sources
An industrial case study embedding domain rules and design principles into an LLM agent's scaffolding achieved 206% output-quality improvement and expert-level ratings from non-experts, bypassing the need for specialist oversight. The capability gain came from externalizing tacit expertise into structured harness components, not from model scale.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Large language models surpass human experts in predicting neuroscience results
- Predicting Empirical AI Research Outcomes with Language Models
- Artificial Intelligence Tools Expand Scientists' Impact but Contract Science's Focus (Just accepted by Nature, to be online soon)
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?
- Interesting Scientific Idea Generation Using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders
- AI Can Learn Scientific Taste
- How to Build AI Agents by Augmenting LLMs with Codified Human Expert Domain Knowledge? A Software Engineering Framework