Why might building a knowledge graph in two passes, extract first and then merge duplicates, beat doing it all at once?
How does two-stage extraction with deduplication improve graph quality over single-pass extraction?
This explores why splitting knowledge-graph construction into an extraction pass and a separate cleanup pass that merges duplicate entities might produce a better graph than extracting everything in one shot.
This explores why splitting knowledge-graph construction into an extraction pass and a separate cleanup pass that merges duplicate entities might produce a better graph than extracting everything in one shot. None of the retrieved notes tests that comparison directly. What follows is the closest neighbouring evidence, and it is partly my inference, not a finding from the corpus.
The nearest match is a general pattern: one pass finds candidates, and a second pass decides whether they are really the same thing. Can verification separate structural near-misses from topical matches? describes a pipeline with cheap, broad recall followed by a small learned verifier. The verifier looks at full token-by-token similarity patterns, so it can reject structural near-misses that only look topically alike. Deduplication in a graph has the same shape. 'Same topic' is not 'same entity', and a broad extraction pass can't reliably tell them apart. If the first pass is allowed to be generous and a second pass owns the question of identity, duplicates get merged without also merging things that merely sound alike.
The extraction side helps explain why one pass isn't enough. Can smaller language models outperform larger ones at graph extraction? argues that graph extraction is mostly a reading task that depends on language comprehension, not remembered facts. A domain-adapted 7B model beat a 32B one at it. A model reading one chunk at a time has no way to know that 'the company' in one chunk is the 'Acme' named in another. Reconciling across chunks is a different job from reading, and it can be handed to a different step or a different, cheaper model.
There is also a noise argument. Can graph structure patterns outperform direct edge signals in noisy data? builds product-substitute graphs from patterns across several edges instead of single edges, because several independent noisy signals rarely line up by accident. A second pass works the same way in spirit. An entity or relation that survives separate extractions and merging is less likely to be a one-off hallucination. This is an analogy from a different domain, not evidence about LLM extraction.
The stakes are downstream. Can community detection enable RAG systems to answer global corpus questions? partitions the entity graph into communities, and Can knowledge graphs enable multi-hop reasoning in one retrieval step? walks it to find multi-hop paths. Both assume each node means one thing. My reading is that duplicate nodes would split a topic across communities or dilute the paths a walk can follow, though the notes don't measure this. Can query-time graph construction replace pre-built knowledge graphs? takes the opposite route and builds a small graph at query time, which avoids corpus-wide extraction and cleanup costs. If you want a direct answer on dedup, the corpus needs a note on entity resolution in graph construction.
Sources 6 notes
A two-stage pipeline—pooled-cosine recall followed by a small Transformer verifier operating on token-token similarity maps—reliably rejects structural near-misses that MaxSim-style late interaction cannot. The verifier succeeds because it operates on full token interaction patterns rather than compressed vectors.
RAGU demonstrates that knowledge graph extraction depends on language comprehension skills, not factual recall, which scale weakly with model size. A 7B domain-adapted model outperformed Qwen2.5-32B on graph construction and matched it on English tasks.
Taobao's Swing algorithm constructs more robust product substitute graphs by exploiting quasi-local bipartite patterns rather than single edges. Structural signals are inherently noise-resistant because they require multiple independent noisy edges to coincidentally align, which rarely happens by chance.
GraphRAG uses Leiden community detection to partition entity graphs into modular groups with pre-generated summaries, enabling map-reduce answering of global questions that pure RAG and prior summarization methods cannot handle efficiently.
HippoRAG converts corpus into a knowledge graph, then uses Personalized PageRank seeded from query concepts to traverse multi-hop paths in one step. It matches iterative retrieval while being 10-20x cheaper and 6-13x faster, with 20% better accuracy on multi-hop QA.
Show all 6 sources
LogicRAG constructs directed acyclic graphs from queries at inference time rather than pre-building corpus-wide graphs, eliminating construction overhead, avoiding staleness, and enabling query-specific retrieval logic without sacrificing multi-hop reasoning capability.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
- You Don't Need Pre-built Graphs for RAG: Retrieval Augmented Generation with Adaptive Reasoning Structures
- Weak-to-Strong GraphRAG: Aligning Weak Retrievers with Large Language Models for Graph-based Retrieval Augmented Generation
- Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities
- From Local to Global: A Graph RAG Approach to Query-Focused Summarization
- Can Language Models Solve Graph Problems in Natural Language?
- BM25 Wins at Scale: A Scaling Study of Retrieval-Augmented Generation Paradigms
- MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries