Transparent medical image AI via an image-text foundation model grounded in medical literature.
Transparent medical image AI via an image-text foundation model grounded in medical literature.
Chanwoo Kim,S. Gadgil,4 Authors,Su-In Lee
2024 · DOI: 10.1038/s41591-024-02887-x
Nature Network Boston · 51 Citations
TLDR
A foundation model approach, named MONET (medical concept retriever), is presented, which learns how to connect medical images with text and densely scores images on concept presence to enable important tasks in medical AI development and deployment such as data auditing, model auditing and model interpretation.
