Abstract:To cope with the large contexts that long-horizon LLM agents produce, modern frameworks increasingly rely on compaction -- invoking an LLM to rewrite the accumulated trajectory into a shorter summary that the agent resumes from. Today, compaction runs synchronously on the critical path of agent execution but this can unpredictably degrade accuracy due to a structural validation gap: the compactor must condense context but is fundamentally unaware of precisely what information the agent will need later. Further, because post-compaction agent steps are conditioned on the new summary, targeted validation criteria do not exist and errors silently propagate through coherent but incorrect behavior. Our key insight is that asynchronous compaction efficiently addresses this gap: by running the compactor in parallel with continued agent execution on the original context, the candidate summary and the agent's next steps are generated independently from the same pre-compaction state, yielding a validation signal independent of the summary itself. We build Slipstream, a trajectory-grounded compaction system that uses a judge to validate the candidate summary against the agent's continued reasoning, checking that it preserves both the agent's forward intent and the key facts and constraints it depends on. Across long-horizon coding (SWE-bench Verified) and web-browsing (BrowseComp) workloads, Slipstream improves task accuracy by up to 8.8 percentage points while reducing end-to-end latency by up to 39.7%.
| Comments: | 9 pages (16 pages counting references, appendix), 6 figures, 2 tables |
| Subjects: | Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI) |
| ACM classes: | I.2.0 |
| Cite as: | arXiv:2605.08580 [cs.MA] |
| (or arXiv:2605.08580v1 [cs.MA] for this version) | |
| https://doi.org/10.48550/arXiv.2605.08580 arXiv-issued DOI via DataCite |
Submission history
From: Zhuofu Chen [view email]
[v1]
Sat, 9 May 2026 00:47:43 UTC (509 KB)