← all papers · overview

Cache Merging as a Convergent Replicated State for Multi-Agent Latent Reasoning

Abstract

Multi-agent latent reasoning composes agents' KV-caches into one context for a final agent. Prior work (Agent Primitives) does this by concatenating caches along the sequence axis with RoPE re-encoding, which we call BagMerge. BagMerge is non-commutative, and the best input ordering is unpredictable, shifting with the regime, the latent-step budget, and the model scale. We make this exchange a convergent replicated state. First, CanonicalMerge fixes the layout by content: ordering caches by mean K-norm at a middle layer renders the merged cache byte-identical under any input permutation, verified algorithmically (arity N2 the approach transports and colocates latent traces but does not by itself compose them, which we characterize to motivate future work.

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).