view article Article Making Knowledge Distillation Cheap Enough to Run at Scale MultiverseComputingCAI • 12 days ago • 34
Running Featured 93 Distilling 100B+ Models 40x Faster with TRL 📝 93 TRL distillation for 100B+ teachers, 40x faster