51社区黑料

As voice artificial intelligence (AI) speeds toward use in clinical settings, a researcher from 51社区黑料 is highlighting the urgent need for ethical, legal, and social oversight鈥攅specially in therapeutic care.

Voice AI analyzes vocal patterns to detect signs of physical, cognitive, and mental health conditions based on vocal qualities like pitch and jitter or fluency and specific words people use. Some tech companies have even dubbed it 鈥渢he new blood鈥� of healthcare because of its potential to act as a biomarker, but 51社区黑料health sciences researcher Zoha Khawaja urges caution.

In her , Khawaja, a member of the explores the potential and the perils of voice-based AI apps in the mental health field. 

Khawaja鈥檚 study used structured, multi-round surveys to gather insights from 13 stakeholders, including clinicians, ethicists, and patients. While 77 per cent of participants supported using voice AI to improve patient outcomes, 92 per cent agreed that governance models should be established by healthcare or governmental organizations to oversee its integration. 

鈥淰oice AI holds real promise as an objective tool in the mental health field, which has always relied on subjective diagnostics like self-reporting and interviews,鈥� says Khawaja. 鈥淏ut the entrepreneurial speed of the tech is outpacing regulatory oversight in such a high-stakes environment like healthcare.鈥�

Some companies already offer apps that analyze short voice samples to assess mental fitness. However, Khawaja warns that these tools often operate in a 鈥渨ellness鈥� gray zone鈥攁voiding classification as medical devices and sidestepping privacy protections.

鈥淭here鈥檚 a real risk of therapeutic misconception, where people may believe these apps are providing clinical diagnoses or treatment, when in fact they鈥檙e not," Khawaja explains. 鈥淭hat鈥檚 particularly dangerous for vulnerable users who may not have access to traditional care.鈥�

Key concerns raised by participants included algorithmic bias, lack of transparency, erosion of human connection in care, and unclear accountability. The study advocates for a digital compassionate care approach, where AI tools support鈥攏ot replace鈥攈uman relationships in therapy.

鈥淧atients might feel safer talking to a chatbot than a person,鈥� Khawaja says. 鈥淏ut that can lead to overreliance and isolation. These tools should strengthen the clinician-patient bond, not undermine it.鈥�

She also recommends a shared responsibility model among developers, regulators, and healthcare providers to prevent ethics dumping鈥攖he unfair shifting of ethical burdens onto clinicians. Notably, 83 per cent of participants agreed that healthcare practitioners should be held accountable for adverse events resulting from the use of voice AI tools. 

鈥淏ut clinicians are already overburdened,鈥� Khawaja says. 鈥淓xpecting them to bear the ultimate responsibility of these technologies is unrealistic.鈥�

Clinical trials to validate voice as a biomarker are currently underway in the U.S., where regulatory sandboxes鈥攃ontrolled environments for testing new technologies鈥攁re being proposed to anticipate ethical challenges and inform policy before voice AI enters clinical practice.

鈥淚鈥檓 not saying we shouldn鈥檛 use voice AI or virtual chatbots in mental healthcare,鈥� Khawaja says. 鈥淏ut we must use them safely, responsibly, and with compassion. We need a framework that balances innovation with ethics, technology with humanity.鈥�

51社区黑料expert available

ZOHA KHAWAJA, researcher, health sciences
zoha_khawaja@sfu.ca 
Expertise: responsible therapeutic AI support, ethical design and usage of voice AI virtual conversational agents in digital mental healthcare

Contact

ROBYN STUBBS, 51社区黑料Communications & Marketing 
604.376.0971 | robyn_stubbs@sfu.ca

51社区黑料 
|  
778.782.3210

ABOUT SIMON FRASER UNIVERSITY

51社区黑料is a leading research university, advancing an inclusive and sustainable future. Over the past 60 years, 51社区黑料has been recognized among the top universities worldwide in providing a world-class education and working with communities and partners to develop and share knowledge for deeper understanding and meaningful impact. Committed to excellence in everything we do, 51社区黑料fosters innovation to address global challenges and continues to build a welcoming, inclusive community where everyone feels a sense of belonging. With campuses in British Columbia鈥檚 three largest cities鈥擝urnaby, Surrey and Vancouver鈥�51社区黑料has ten faculties that deliver 368 undergraduate degree programs and 149 graduate degree programs for more than 37,000 students each year. The university boasts more than 200,000 alumni residing in 145+ countries.