The researchers sought to evaluate the quality of a novel AI summarization tool for ongoing hospital care in real-world clinical settings at multiple tertiary academic hospital sites within a large integrated healthcare system.
An AI summarization tool was created to provide a “Patient Story”, specialty-specific “Recent Notes”, and “Recent Events” over the previous 24 or 72 hours.
To do this, the AI features of this tool were evaluated using the PDSQI-9 framework, qualitative end user feedback, and utilization metrics.
Users rated the tool favorably across all PDSQI-9 domains, with a combined average score of 4.68 (range 4.56–4.78, S.D. 0.67) across the eight domains scored on a 5-point modified Likert scale.
Utilization metrics demonstrated strong uptake with frequent views.
An LLM-based summarization tool for ongoing hospitalization care was rated of high quality by diverse clinicians in real-world settings, demonstrated a favorable safety profile, and showed sustained utilization.
【MORE】