Efficient Transformers & Distillation
-
Read on arXiv
Alternating Updates for Efficient Transformers
-
Read on arXiv
SLaM: Student-Label Mixing for Distillation with Unlabeled Examples
-
Read on arXiv
Robust Active Distillation
-
Read on arXiv
Weighted Distillation with Unlabeled Examples