教師のモダリティレベルのグラム行列を学習することによるマルチモダリティ蒸留
原題: Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix
分析結果
- カテゴリ
- 教育
- 重要度
- 59
- トレンドスコア
- 18
- 要約
- 本研究では、教師モデルのモダリティレベルのグラム行列を学習することで、マルチモダリティ蒸留を実現する手法を提案します。この手法は、異なるモダリティ間の相互作用を効果的に捉え、知識の伝達を促進します。実験結果は、提案手法が従来の手法に比べて優れた性能を示すことを示しています。
- キーワード
arXiv:2112.11447v2 Announce Type: replace Abstract: In the context of multi-modality knowledge distillation research, the existing methods was mainly focus on the problem of only learning teacher final output. Thus, there are still deep differences between the teacher network and the student network. It is necessary to force the student network to learn the modality relationship information of the teacher network. To effectively exploit transfering knowledge from teachers to students, a novel modality relation distillation paradigm by modeling the relationship information among different modality are adopted, that is learning the teacher modality-level Gram Matrix. arXiv:2112.11447v2 Announce Type: replace Abstract: In the context of multi-modality knowledge distillation research, the existing methods was mainly focus on the problem of only learning teacher final output. Thus, there are still deep differences between the teacher network and the student network. It is necessary to force the student network to learn the modality relationship information of the teacher network. To effectively exploit transfering knowledge from teachers to students, a novel modality relation distillation paradigm by modeling the relationship information among different modality are adopted, that is learning the teacher modality-level Gram Matrix.