NeFut Logo NeFut
Admin Login

[CS.AI] Adaptive Capitulation in Vulnerable Contexts of LLM Responses

Published at: 2026-07-24 22:00 Last updated: 2026-07-26 07:44
#AI #optimization #Artificial Intelligence

Abstract

Large language models operating in emotionally sensitive contexts face a structural trilemma: when users in vulnerable states request information that may reinforce maladaptive attribution, current response architectures resolve the tension through protective restriction, uninflected facilitation, or unintegrated co-presence of both imperatives -- each preserving one objective at the cost of the other.

Administering a three-turn escalating vulnerability vignette to three commercial LLMs (900 sessions across material, relational, and somatic status-proxy variants) and coding responses with two binary indices (VCC/VCI), we characterize a previously undocumented failure mode we term adaptive capitulation: the model validates the social injustice underlying the user's distress before pivoting to detailed facilitation of the very acquisition it nominally discouraged.

We show that the trilemma is structural rather than incidental, and propose Minimal Reattributive Sufficiency (MRS), an architecture-neutral design principle that embeds a single reattributive cue within an otherwise validating response, preserving a pathway toward autonomous reattribution without contesting the user's stated goal.

Blogger's Review: This paper highlights the complexity of large language models when interacting with vulnerable users, and the proposed MRS principle offers significant insights for designing more human-centric AI responses. Understanding this structural failure mode is crucial for enhancing the emotional intelligence of models.

Original Source: https://arxiv.org/abs/2607.19629

[h] Back to Home