Submitted by
hankai
HUAWEI Noah's Ark Lab
company
Verified
AI & ML interests
Artificial Intelligence
Papers
ROOT: Robust Orthogonalized Optimizer for Neural Network Training
Revealing the Power of Post-Training for Small Language Models via Knowledge Distillation