UPDF AI

Transparent medical image AI via an image-text foundation model grounded in medical literature.

Chanwoo Kim,S. Gadgil,4 Authors,Su-In Lee

2024 · DOI: 10.1038/s41591-024-02887-x
Nature Network Boston · 51 Citations

TLDR

A foundation model approach, named MONET (medical concept retriever), is presented, which learns how to connect medical images with text and densely scores images on concept presence to enable important tasks in medical AI development and deployment such as data auditing, model auditing and model interpretation.