NeFut Logo NeFut
Admin Login

[CS.AI] We Built a Mirror and Mistook It for a Mind: Causal Liability and the AI Consciousness Fallacy

Published at: 2026-09-10 22:00 Last updated: 2026-09-12 06:35
#AI #Machine Learning #LLM

The current debate on machine consciousness rests on a hidden premise: that the entity labeled "AI" already qualifies as a potential bearer of consciousness. This paper first separates phenomenal consciousness, introspective reports, and human projective introspection, arguing that generative systems can produce first‑person linguistic traces of human interiority without actually possessing a phenomenal bearer.

From this observation the AI Consciousness Fallacy is defined: mistaking a system's output for evidence of consciousness. The authors then introduce Causal Liability Theory (CLT). CLT‑I proposes liability closure as a criterion for individuating a candidate bearer: a physically continuous process becomes the non‑delegable inheritor of constraints generated by its own endogenous discriminations.

CLT‑II extends the claim, positing that liability closure is both necessary and sufficient for minimal phenomenal subjecthood. To test these claims, an open‑weight causal audit is performed across several model families.

Key experimental observations include:

The results demonstrate that CLT‑I distinctions are experimentally tractable and can separate causal bearer structure from first‑person performance. Consequently, the framework isolates consciousness attribution, causal bearer individuation, and the metaphysical question of consciousness constitution as distinct layers.

Review: The paper offers a concrete experimental methodology that cautions against equating linguistic output with genuine subjective experience, and it advances a formal approach to causal responsibility in AI systems.

Original Source: https://arxiv.org/abs/2609.06715

[h] Back to Home