AI Chatbots for Mental Health Self-Management: Lived Experience–Centered Qualitative Study
Чат-боты на основе искусственного интеллекта для самоуправления психическим здоровьем: качественное исследование, сфокусированное на личном опыте
2026-02-25
SCID: 54.1/f9kmg6fx
Discuss with AI
depression self-managementlarge language modelsmental health chatbotspersonalization-privacy dilemmaqualitative content analysis
Figures from the paper
Abstract (AI)
Background: Large language models (LLMs) now enable chatbots to engage in sensitive mental health conversations, including depression self-management. Yet their rapid deployment often overlooks how well these tools align with the priorities of people with lived experiences, which can introduce harms such as inaccurate information, lack of empathy, or inadequate crisis support. Objective: This study explores how people with lived experience of depression experience an LLM-based mental health chatbot in self-management contexts, and what perceived benefits, limitations, and concerns inform harm-mitigating design implications. Methods: We developed a technology probe (a GPT-4o-based chatbot named Zenny) designed to simulate depression self-management scenarios grounded in prior research. We conducted interviews with 17 individuals with lived experiences of depression, who interacted with Zenny during the session. We applied qualitative content analysis to interview transcripts, notes, and chat logs using sensitizing concepts related to values and harms. Results: We identified 3 themes shaping participants' evaluations: (1) informational accuracy and applicability, including concerns about incorrect or misleading information, vagueness, and fit with personal constraints; (2) emotional support vs need for human connection, including validation and a judgment-free space alongside perceived limits of machine empathy; and (3) a personalization-privacy dilemma, where participants wanted more tailored guidance while withholding sensitive information and using privacy-preserving tactics. Conclusions: People with lived experience of depression evaluated LLM-based mental health chatbots through intertwined priorities of actionable information, emotional validation with clear limits, and personalization that does not require unsafe data disclosure. These findings suggest concrete design strategies to mitigate harms and support LLM-based tools as complements to, rather than replacements for, human support and recovery.
Key Findings
1
Interviews with 17 people with lived experience of depression identified three priorities shaping evaluations of the GPT-4o chatbot Zenny.
2
Participants valued actionable, applicable information but raised concerns about inaccuracies, misleading or vague guidance, and poor fit with personal constraints.
3
Participants wanted personalized guidance while withholding sensitive information, revealing a fundamental personalization–privacy dilemma.
4
The chatbot provided validation and a judgment-free space, but participants viewed machine empathy as limited and emphasized the need for human connection.
5
The findings support designing LLM mental health tools as complements to human support, with harm mitigation around accuracy, emotional limits, crisis support, and data privacy.
Research Object
LLM-based mental health chatbots used by people with lived experience of depression for self-management
Research Subject
Participants’ perceived benefits, limitations, harms, and design priorities concerning informational accuracy, emotional support, human connection, personalization, and privacy
Publication Details
Publication Date
2026-02-25
Journal
Publisher
ISSN
Cited by
7
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest