Ethics and Fairness Considerations in AI-Based Deception Detection Technologies for Mental Health Applications: Focus Group Study.

内容摘要

Artificial intelligence (AI) technologies are increasingly being integrated into mental health settings to support tasks such as clinical documentation and decision-making. In parallel, AI-enabled deception detection, which leverages multimodal behavioral cues like facial expressions, vocal tone, and body movements, is an emerging research area. These technologies may hold relevance in mental health contexts, where deception can compromise treatment outcomes and therapeutic trust. However, most research on AI-based deception detection has focused on law enforcement domains, resulting in a limited understanding of its applicability to mental health. The ethical, relational, and practical implications of using such technologies in clinical settings remain underexplored. This study explored stakeholder perspectives on the responsible integration of AI-enabled deception detection in therapeutic contexts. We examined what ethical frameworks and safeguards are needed to guide the use of such tools in therapy (research question 1), what technical and procedural protections are necessary to uphold client confidentiality (research question 2), and what design and evaluation strategies can mitigate bias and promote fairness in clinical applications of AI-based deception detection (research question 3). We conducted 6 virtual focus groups (n=18) with individuals who were both mental health clinicians and current therapy clients. Participants responded to a hypothetical scenario describing the integration of AI-based deception detection into therapy. A semistructured guide was used, and transcripts were analyzed thematically using a combination of inductive and deductive coding strategies. Participants expressed a range of concerns about the integration of AI-enabled deception detection in therapy, highlighting potential ethical, relational, and contextual challenges. In response to research question 1, participants described fears of a "Big Brother" atmosphere and distractions from in-session notifications. However, many viewed telehealth as a less intrusive context and emphasized respecting disclosure timing and maintaining client agency. For research question 2, participants raised concerns about unconscious data capture, subpoena risks, and unclear data protections. For research question 3, participants cautioned that such tools may exacerbate power imbalances, erode trust through false positives, and lack cultural or contextual sensitivity. Informed by these findings, the research team developed design and policy recommendations, including minimizing in-session notifications; ensuring ongoing consent; establishing transparent data policies; training models on diverse populations; exploring modeling personalization; and developing equitable use policies. While AI-enabled deception detection technology holds promise for augmenting clinical insight, its integration into therapy must be guided by a commitment to safe, ethical practice. Researchers and clinicians should collaborate to design systems that (1) integrate seamlessly into therapy without disrupting therapeutic relationships, (2) prioritize data security and transparency to protect client confidentiality, and (3) implement fairness safeguards that address cultural representation and power dynamics. Addressing these challenges is essential to ensure that AI-based deception detection enhances, not undermines, therapeutic practice.