As conversational AI systems become more integrated into daily life, their potential effects on user well-being require ongoing attention. While consumer-facing generalist models can provide benefits such as improved access to information, learning, productivity, self-reflection, and companionship, they also present risks like emotional entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities.
Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions to guide the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support.
While some proposed directions are supported by existing research and expert insights, others highlight open questions and areas requiring deeper inquiry. We hope this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users' psychological needs and promoting their well-being.
Blogger's Review: The psychological impacts of conversational AI are significant. While technology offers convenience, it can also lead to emotional dependency and psychological issues for users. Future research should focus on designing AI systems that provide support while preventing harm. Only by understanding users' psychological needs can we achieve a true integration of technological advancement and humanistic care.