CoMViT: An Efficient Vision Backbone for Supervised Classification in Medical Imaging

📝 Original Info

• Title: CoMViT: An Efficient Vision Backbone for Supervised Classification in Medical Imaging
• ArXiv ID: 2510.27442
• Date: 2025-10-31
• Authors: ** 논문에 명시된 저자 정보가 제공되지 않았습니다. (보통은 첫 번째 저자, 공동 저자, 교신 저자 등을 포함합니다.) **

📝 Abstract

Vision Transformers (ViTs) have demonstrated strong potential in medical imaging; however, their high computational demands and tendency to overfit on small datasets limit their applicability in real-world clinical scenarios. In this paper, we present CoMViT, a compact and generalizable Vision Transformer architecture optimized for resource-constrained medical image analysis. CoMViT integrates a convolutional tokenizer, diagonal masking, dynamic temperature scaling, and pooling-based sequence aggregation to improve performance and generalization. Through systematic architectural optimization, CoMViT achieves robust performance across twelve MedMNIST datasets while maintaining a lightweight design with only ~4.5M parameters. It matches or outperforms deeper CNN and ViT variants, offering up to 5-20x parameter reduction without sacrificing accuracy. Qualitative Grad-CAM analyses show that CoMViT consistently attends to clinically relevant regions despite its compact size. These results highlight the potential of principled ViT redesign for developing efficient and interpretable models in low-resource medical imaging settings.

💡 Deep Analysis

📄 Full Content

Reference