Abstract:As large language models are increasingly deployed in retrieval-augmented generation and agentic systems that accumulate extensive context, understanding how distracting information affects long-context performance becomes critical. Prior work shows that semantically relevant yet misleading documents degrade performance, but the quantitative relationship between the proportion of distractors and performance remains unstudied. In this work, we systematically vary the hard-distractor proportion in fixed-length contexts, revealing a striking nonlinear pattern: as the proportion of hard distractors increases, performance drops sharply within the first small fraction, while the remainder of the range yields only marginal additional decline. We term this ''The First Drop of Ink'' effect, analogous to how a single drop of ink contaminates water. Our theoretical and empirical analyses grounded in attention mechanics show that hard distractors capture disproportionate attention even at small proportions, with diminishing marginal impact as their proportion grows. Controlled experiments further show that filtering gains mainly come from context-length reduction rather than distractor removal; substantial recovery requires reducing the hard-distractor proportion to near zero, highlighting the importance of upstream retrieval precision.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2605.10828 [cs.AI] |
| (or arXiv:2605.10828v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2605.10828 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Muhan Gao [view email]
[v1]
Mon, 11 May 2026 16:46:20 UTC (443 KB)