NeFut Logo NeFut
Admin Login

[CS.AI] StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systems

Published at: 2026-08-15 22:00 Last updated: 2026-08-16 07:03
#LLM #Artificial Intelligence #Latent Communication

Recent work proposes latent communication as an alternative, where agents transmit hidden representations directly without converting them to text. However, existing latent methods either inject working memory layer by layer across the transformers, or require trained projectors that limit portability. We propose StateBridge, a training-free latent communication approach that aligns the sender's final-layer hidden states to the receiver's input space via a closed-form orthogonal transformation. Lightweight norm calibration and vocabulary anchoring ensure compatibility with the pretrained input distribution. The aligned states are prepended to the input of the receiver agent as a continuous prefix. We evaluate StateBridge on math reasoning, code generation, and question answering with four models from two families. StateBridge achieves the best or tied-best score on 22 out of 26 model-task pairs, consistently outperforming the strongest baseline. Blogger's Review: The proposal of StateBridge provides a new perspective for latent communication in LLM multi-agent systems, achieving hidden state alignment without training, which improves system performance and portability. This method has a broad application prospect and is worth further research and exploration.

Original Source: https://arxiv.org/abs/2608.13317

[h] Back to Home