康奈尔大学与Crisis Text Line开发NLP新方法,测量危机咨询师对话技能如何提升
A new way to measure how crisis counseling skills improve
康奈尔大学与Crisis Text Line开发出一种自然语言处理方法,通过识别危机对话中的"downturn"转折点,追踪咨询师应对能力的长期变化。研究分析2015年1月至2020年10月的逾150万条去标识化对话,用内部部署的大语言模型按1-5分评估结局,并比较咨询师早期与近期各50次对话。研究者称该方法尚需更多测试才能用于咨询师培训。
Being a good listener can sometimes involve more than just listening. It can also mean knowing when and how to say just the right thing—a conversational skill that's invaluable to a crisis counselor.
It's also a skill that can be learned, and researchers from the Cornell Ann S. Bowers College of Computing and Information Science and Crisis Text Line, a global nonprofit that provides free, confidential mental health support, have developed a method for tracking how counselors hone their ability to steer conversations with clients toward positive outcomes and identifying early in a counselor's career if they are likely to improve.
"Crisis counselors regularly navigate high-stakes conversations," said lead author Vivian Nguyen '24, M.S. '25, a doctoral student in the field of computer science. "We wanted to understand how they get better at handling these conversations over time, and whether we could tell early on which counselors might benefit more from additional support."
Nguyen is lead author of "Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors," which she presented at the Conference on Empirical Methods in Natural Language Processing, held Oct. 24–29 in Budapest, Hungary.
The research team, led by Cristian Danescu-Niculescu-Mizil, professor of information science (Cornell Bowers), used natural language processing (NLP) to identify pivotal "downturn" moments in an online crisis conversation, where a counselor may struggle to keep a person calm and talking or texting. The method also captures how the same counselor adapted their response when faced with a similar moment in conversations later in their career.
Danescu-Niculescu-Mizil is senior author; other contributors are Lillian Lee '93, the Charles Roy Davis Professor of Computer Science (Cornell Bowers), and Elizabeth Olson, vice president for AI/NLP clinical research science at Crisis Text Line. The team charted the progress of Crisis Text Line's volunteer crisis counselors for the research.
The counselors receive standardized training, including how to handle conversations, but aren't offered guidance on how to improve over time. Two of the Cornell co-authors completed the training program as part of the research.
Nguyen and the team analyzed more than 1.5 million deidentified conversations, from January 2015 to October 2020, and used NLP to identify conversation outcomes based on whether a texter either abruptly ended a conversation or was guided to a more positive state. Using an internally hosted large language model (LLM), the researchers gave conversations a score from 1 to 5, with higher scores corresponding to more positive outcomes.
To measure improvement, the researchers compared the counselors' performance at two distinct points in their careers. Analyzing counselors with at least 125 conversations (around 20 months), they compared the first 50 from their early career with the most recent 50 from their late career.
The researchers first used a method to identify "downturn" moments—points that signaled a difficulty in the conversation, even if neither party was aware of it. The method detects at which points in the conversation the expectation about how the conversation will end takes a turn for the worse. The team also analyzed other moments in the conversations, including random ones, to confirm that responses to downturn moments yielded the most information about whether a counselor will improve from their early to late career.
Another system learned how to summarize how counselors changed the way they respond to downturn moments. The system was internally hosted due to data privacy concerns. This "learning from mistakes" method demonstrates the feasibility of their approach, which will require more testing before it can be deployed for counselor training, the researchers said.
Danescu-Niculescu-Mizil stressed that "our work is in no way aiming to replace human counselors with AI." But it is an example, he said, of how an NLP model can be used to hone counselor conversational skills.
Olson agreed. "This research opens doors to thinking about how to better support human crisis responders as they learn from experience," she said.
More information
Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors, Conference on Empirical Methods in Natural Language Processing, 2026.emnlp.org/
Who's behind this story?
Gaby Clark
MA in English, copy editor since 2021 with experience in higher education and health content. Dedicated to trustworthy science news. Full profile →
Andrew Zinin
Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →
Citation: A new way to measure how crisis counseling skills improve (2026, October 28) retrieved 28 October 2026 from https://medicalxpress.com/news/2026-10-crisis-skills.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
来源:Medical Xpress · medicalxpress.com