NeFut Logo NeFut
中 Admin Login

[CS.AI] Claims of Emergence in AI Should Be Grounded in Information Decomposition

Published at: 2026-10-22 22:00 Last updated: 2026-10-25 13:04
#algorithm #AI #Machine Learning

When a language model exhibits capabilities that cannot be traced to any single component, or when a multi‑agent system outperforms each agent alone, researchers label the phenomenon as “synergy” or “emergence”. Such claims are usually informal and lack a common theoretical basis, making comparison or dispute difficult. We argue that information decomposition offers a unifying formal framework to operationalize assessments of synergy in AI systems. The framework distinguishes three qualitatively different types of information: unique information available from individual components, redundant information shared across components, and synergistic information that can only be accessed when components are considered together. According to this view, a system’s behavior is emergent only if it carries synergistic information about task‑relevant outcomes. We illustrate the approach on attention heads, autonomous agents, and human‑AI teams, showing how it organizes existing knowledge across scales and substrates while generating cross‑level conjectures that siloed fields would miss.

Review: Information decomposition provides a measurable, falsifiable criterion for AI emergence, paving the way for more systematic, interdisciplinary investigations.

Original Source: https://arxiv.org/abs/2610.28479

[h] Back to Home