跳到正文
arXiv · 机器人与计算机视觉· Shuaibu Shehu (SR University), Elijah M. Flomo (SR University), Mohammad Safiya (GITAM University), Anurodh Kumar (SR University), Subodh Kumar (Dr. KNS Memorial Institute of Medical Sciences)·· 23 天前AI 评分36

LiteMed-ViT:跨架构知识蒸馏实现轻量级医疗视觉 Transformer 的高效部署

Promise and Limits of Cross-Architecture Knowledge Distillation for Lightweight Medical Vision Transformers (LiteMed-ViT)

AI 导读

LiteMed-ViT 通过从 ResNet18 教师网络向轻量级 ViT 学生模型进行双 Token 知识蒸馏,仅用 0.234M 参数和 0.89 MB 内存即可在 BloodMNIST 达到 95.05% 准确率。

来源:arXiv · 机器人与计算机视觉 · arxiv.org