AI model to help tackle aggression in the ED

A new research project has integrated artificial intelligence (AI) into an immersive virtual-reality-enhanced computer simulation program to train frontline healthcare workers in de-escalating aggression in patients.

Barry, an AI computer-based model developed by researchers at the Edith Cowan University (ECU), allows clinicians and students to verbally interact with him in a hospital setting.

Users have an actual conversation with Barry, and he responds in real time. Given the use of AI, Barry’s response to each verbal interaction is entirely unique, even if users provide the same wording more than once. The training simulation incorporates emotive facial animations that align with real-time verbal responses, and Barry’s anger levels will either escalate or de-escalate based on the empathy displayed from the user.

The unique responses given by Barry are based on upfront prompting from the development team, outlining the gender, race and age of the user undertaking the training, which can be customised to suit different user profiles.

“Exposure to aggression and violence is an unfortunate reality for frontline healthcare staff on the forefront of the healthcare system. These incidents have long-lasting impacts on healthcare workers,” said ECU Senior Lecturer Dr Brennen Mills.

“Health departments provide de-escalation and safety training to staff to prepare them to manage aggressive incidents in healthcare settings. However, access to training can sometimes prove difficult within busy healthcare systems, and exposing learners to realistic simulations that are also safe is highly resource-intensive and problematic to implement at scale, particularly in rural and remote areas,” Mills said.

Mills said that this project has the capacity to revolutionise education and training practices for healthcare workers in the aggression and violence de-escalation space.

The project, led by the Simulation & Immersive Digital Technology Group at ECU, has been supported by a multitude of work health safety and clinical staff across the Department of Health WA and was funded through the Future Health Research Innovation Fund (FHRI) Generative AI Challenge Scheme.

Workplace Violence & Aggression Coordinator, South Metropolitan Health Service, Department of Health WA, Kallan Griffin said simulation systems like Barry could provide frontline healthcare workers with life-like experience, without placing the users in the way of actual harm.

“The integration of the AI into the immersive computer simulation provides an element of randomness, which is what we are constantly faced with every day in a hospital setting. This system provides staff with an opportunity to practise in a safe environment, and to build their skill sets and knowledge base in that setting.

“The opportunity that it possibly could present is that we can help staff to identify knowledge gaps and provide authentic and realistic training opportunities to improve their own practice in this space.”

Barry is currently in its first phase of development, and Mills noted that the second phase of development would incorporate motion capture to create animated body movements for Barry to match his speech and facial expressions that could include situations where Barry actually turns physically violent.

Additional work will also address lag times between prompt and response times, as well as further work to refine Barry’s AI model to respond to different user profiles.

Image credit: iStock.com/Halfpoint