Paper 13407-123
Paper 13407-123
AIM-CU: A statistical tool for AI monitoring
19 February 2025 • 5:30 PM - 7:00 PM PST | Golden State Ballroom
Abstract
Artificial Intelligence (AI) tools have become increasingly prevalent in all aspects of healthcare. However, their adoption into the clinical setting has been limited. Monitoring a clinically deployed device to detect performance drift is an essential step to ensure the patient safety and effectiveness of the device. In this work, we describe a statistical tool for AI monitoring using cumulative sum (AIM-CU) control chart. AIM-CU computes: (i) the parameter choices for change-point detection based on an acceptable false alarm rate (ii) detection delay estimates for a given displacement of the performance metric from the target for those parameter choices.
Presenter
U.S. Food and Drug Administration (United States)
Smriti Prathapan is an ORISE fellow at the Division of Biomedical Physics at OSEL/CDRH/FDA. Her research is focused on the development of digital biomarkers for mild traumatic brain injury. In the past, she has worked on the detection of performance drift for medical AI.