Artificial intelligence for automated detection of diabetic foot ulcers: a real-world proof-of-concept clinical evaluation.
Artificial intelligence for automated detection of diabetic foot ulcers: a real-world proof-of-concept clinical evaluation.
B. Cassidy,Moi Hoon Yap,7 Authors,Neil D. Reeves
2023 · DOI: 10.1016/j.diabres.2023.110951
Diabetes Research and Clinical Practice · 35 Citations
TLDR
High levels of inter- and intra-rater reliability for clinician agreement on the ability of the artificial intelligence system to detect diabetic foot ulcers was demonstrated, and this is the first key stage in the creation of a fully automated diabetic foot Ulcer detection and monitoring system.
Abstract
OBJECTIVE
Conduct a multicenter proof-of-concept clinical evaluation to assess the accuracy of an artificial intelligence system on a smartphone for automated detection of diabetic foot ulcers.METHODS
The evaluation was undertaken with patients with diabetes (n = 81) from September 2020 to January 2021. A total of 203 foot photographs were collected using a smartphone, analysed using the artificial intelligence system, and compared against expert clinician judgement, with 162 images showing at least one ulcer, and 41 showing no ulcer. Sensitivity and specificity of the system against clinician decisions was determined and inter- and intra-rater reliability analysed.RESULTS
Predictions/decisions made by the system showed excellent sensitivity (0.9157) and high specificity (0.8857). Merging of intersecting predictions improved specificity to 0.9243. High levels of inter- and intra-rater reliability for clinician agreement on the ability of the artificial intelligence system to detect diabetic foot ulcers was also demonstrated (Kα > 0.8000 for all studies, between and within raters).CONCLUSIONS
We demonstrate highly accurate automated diabetic foot ulcer detection using an artificial intelligence system with a low-end smartphone. This is the first key stage in the creation of a fully automated diabetic foot ulcer detection and monitoring system, with these findings underpinning medical device development.