ArticleFirst author
Applying vision transformer to assess multi-scale morphological features in mammography for breast cancer detection: multiscale image morphological extraction vision transformer (MIME-ViT)
Y. Kashiwada, E. Takaya, M. Hiroya, et al. — PeerJ Computer Science, 11:e3252
MIME-ViT fuses four Vision Transformer branches with different patch sizes and a CNN branch to localize masses and calcifications on mammograms. Trained from scratch on the TOMPEI-CMMD annotations, it reached a mean IoU of 0.3342: better than DETR without pre-training, but below pre-trained DETR and YOLOv8x.
- Mean IoU (all lesions)
- 0.3342
- Mean IoU (mass)
- 0.3797
- Mean IoU (calcification)
- 0.2491