Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation
Paper • 2610.40574 • Published • 13
None defined yet.
Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation
Advancing SVD-based LLM Compression via Layer-Wise Error Model Search