arXiv · 机器人与计算机视觉· Shuaibu Shehu (SR University), Elijah M. Flomo (SR University), Mohammad Safiya (GITAM University), Anurodh Kumar (SR University), Subodh Kumar (Dr. KNS Memorial Institute of Medical Sciences)·· 23 天前AI 评分36
LiteMed-ViT:跨架构知识蒸馏实现轻量级医疗视觉 Transformer 的高效部署
Promise and Limits of Cross-Architecture Knowledge Distillation for Lightweight Medical Vision Transformers (LiteMed-ViT)
AI 导读
LiteMed-ViT 通过从 ResNet18 教师网络向轻量级 ViT 学生模型进行双 Token 知识蒸馏,仅用 0.234M 参数和 0.89 MB 内存即可在 BloodMNIST 达到 95.05% 准确率。
来源:arXiv · 机器人与计算机视觉 · arxiv.org