NeFut Logo NeFut
Admin Login

[CS.AI] Compute Globally, Materialize Locally: The Memory Contract of Sparse Event-KV

Published at: 2026-07-29 22:00 Last updated: 2026-07-30 03:24
#algorithm #AI #Machine Learning

Abstract

Long-horizon agents increasingly reuse their KV cache as memory: a serving system keeps a subset of cached entries and drops the rest. Eviction and episodic-memory schemes rest on a premise rarely tested directly, that a retained event is still informative once the observations that produced it are gone. We test it by omitting one earlier observation from what is served, across otherwise identical agent histories. Among items sensitive to that observation, the answer overwhelmingly follows the omitted value, though no served span says which value is correct. We call this semantic materialization: a downstream event's cached rows act as an independently servable view of computation whose inputs are gone.

It can also be written on purpose. A deliberately phrased, answer-free event raises donor-aligned recovery from 6% to 51% on Qwen3-8B without ever naming the value, whereas passively harvesting natural mentions from long-term dialog yields no detected advantage. What such a row carries is specific and bounded. Compact state survives, larger payloads decay toward chance, and whether a construction writes at all turns on phrasing rather than on meaning alone, so two phrasings the model comprehends equally well can diverge sharply.

The result is a memory contract for sparse event-KV serving: what to write, where it lands, and what survives once the source is gone. For anyone who evicts, the corollary is that dropping a source event and observing no accuracy loss does not show the source was unnecessary.

Blogger's Review: This paper explores how agents utilize KV caches as memory, introducing a novel concept of memory contract that emphasizes semantic materialization and its impact on agent performance. This research offers new insights into the memory mechanisms of agents and deserves close attention.

Original Source: https://arxiv.org/abs/2607.23693

[h] Back to Home