Skip to content

Main Navigation

Supporting the quality of SafeUT: The evaluation of text-based crisis counseling with machine learning.


Suicide is a leading cause of death among people ages 10-34. The suicide rate in Utah is higher than the national average, with 600 deaths and 4500 attempts each year. SafeUT is an app that provides 24/7 access to text-based crisis support from trained counselors to 734,587 students (81% of all Utah K-12 schools and Universities). With over 20,000 crisis chats on SafeUT in the last year, their volume places a burden on counselors, their supervisors, and systems to train and support the quality of crisis chats; the scale of unstructured text from crisis chats means that it is not feasible to evaluate most encounters. Supervisors must make arbitrary or reactive decisions in regards to what chats to review. Thus, scalable systems to support quality text-based interventions are essential to the impact of SafeUT and other similar text-based counseling platforms.

This proposal will support the creation of a multidisciplinary team to evaluate machine learning tools that assess the quality of text-mediated crisis counseling in real-time.

AIM 1: Use the text of crisis chats to build natural language processing (NLP) models that can predict continued user engagement (i.e. if a user responds to counselor messages).

AIM 2: Utilize human ratings of chat quality to train and evaluate the performance of NLP models that automatically rate counselor messages, and highlight specific interactions where the counselor could benefit from further consultation.

Collaborators

ZAC IMEL
College of Education
Educational Psychology
Project Owner

AMANDA BAKIAN
School of Medicine
Psychiatry

VIVEK SRIKUMAR
College of Engineering
School of Computing

Project Info

Funded Project Amount
$30K

Keywords
Suicide; Counseling; Machine learning; Technology; Natural Language Processing; Student Mental Health

Project Status
Funded 2020
Last Updated: 1/23/20