Postimplementation Evaluation in Assisted Living Facilities of an eHealth Medical Device Developed to Predict and Avoid Unplanned Hospitalizations: Pragmatic Trial

Background:
The proportion of very old adults in the population is increasing, representing a significant challenge. Due to their vulnerability, there is a higher frequency of unplanned hospitalizations in this population, leading to adverse events. Digital tools based on artificial intelligence (AI) can help to identify early signs of vulnerability and unfavorable health events and can contribute to earlier and optimized management.
Objective:
This study aims to report the implementation in assisted living facilities of an innovative monitoring system (Presage Care) for predicting the short-term risk of emergency hospitalization. We describe its use and assess its performance.
Methods:
An uncontrolled multicenter intervention study was conducted between March and August 2022 in 7 assisted living facilities in France that house very old and vulnerable adults. The monitoring system was set up to provide alerts in cases of a high risk of emergency hospitalization. Nurse assistants (NAs) at the assisted living facilities used a smartphone app to complete a questionnaire on the functional status of the patients, comprising electronic patient-reported outcome measures (ePROMs); these were analyzed in real time by a previously designed machine learning algorithm. This remote monitoring of patients using ePROMs allowed notification of a coordinating nurse or a coordinating NA who subsequently informed the patient’s nurses or physician. The primary outcomes were the acceptability and feasibility of the monitoring system in the context and confirmation of the effectiveness and efficiency of AI in risk prevention and detection in practical, real-life scenarios. The secondary outcome was the hospitalization rate after alert-triggered interventions.
Results:
In this study, 118 of 194 (61%) eligible patients were included who had at least 1 follow-up visit. A total of 38 emergency hospitalizations were documented. The system generated 92 alerts for 47 of the 118 (40%) patients. Of these 92 alerts, 46 (50%) led to 46 health care interventions for 14 of the 118 (12%) patients and resulted in 4 hospitalizations. The other 46 of the 92 (50%) alerts did not trigger a health care intervention and resulted in 25 hospitalizations (P<.001). Almost all hospitalizations were associated with a lack of alert-triggered interventions (P<.001). System performance to predict hospitalization had a high specificity (96%) and negative predictive value (99.4%).
Conclusions:
The Presage Care system has been implemented with success in assisted living facilities. It was well accepted by coordinating nurses and performed well in predicting emergency hospitalizations. However, its use by NAs was less than expected. Overall, the system performed well in terms of performance and clinical impact in this setting. Nevertheless, further work is needed to improve the moderate use rate by NAs.