Copenhagen study: ML beats dispatchers at stroke recognition
TL;DR
- A machine-learning pipeline caught 63.0% of stroke cases on 2021 Copenhagen helpline calls, versus 52.7% for human call-takers.
- Positive predictive value rose from 17.1% for call-takers to 24.9% for the model, with p < 0.0001 for the difference.
- The system transcribes calls with an automatic speech recognition model, then classifies the text as stroke or non-stroke.
A machine-learning pipeline trained on six years of Copenhagen medical-helpline calls flagged 63.0% of stroke cases on a held-out 2021 test set, against 52.7% for the human call-takers handling the same calls, according to a retrospective study in npj Digital Medicine.
The researchers used calls from 1 January 2015 to 31 December 2020 to train an automatic speech recognition model paired with a text classifier, then evaluated on 2021 calls. On that test set, call-takers reached a sensitivity of 52.7% (95% CI 49.2–56.4%) with a positive predictive value of 17.1%. The framework, the paper reports, performed "significantly better (p < 0.0001) with a sensitivity of 63.0% (62.0–64.1%) and a PPV of 24.9% (24.3–25.5%)."
The data comes from Copenhagen Emergency Medical Services, with authors drawn from Copenhagen University Hospital, the Technical University of Denmark, and Corti, a Danish company that sells AI tooling to emergency dispatch services. The pipeline classifies calls after transcription, and the study is retrospective: no live deployment alongside call-takers is reported.
The authors frame the system as a "supportive tool for call-takers, aiding in early and accurate stroke recognition," not a replacement. The paper does not report end-to-end latency, nor how the classifier handles non-Danish speakers or calls where the patient cannot speak for themselves.
Shared on Bluesky by 1 AI expert
Originally reported by nature.com
Read the original article →Original headline: A retrospective study on machine learning-assisted stroke recognition for medical helpline calls - npj Digital Medicine