Dynamic Multi-Byte Prediction With Hierarchical Language Models Paper • 2608.15454 • Published 5 days ago • 17
Dynamic Multi-Byte Prediction With Hierarchical Language Models Paper • 2608.15454 • Published 5 days ago • 17
LayRA Collection All datasets used for evaluation in our paper titled: Continually Adding New Languages to Multilingual Language Models • 4 items • Updated Mar 7
view article Article Tokenization in Transformers v5: Simpler, Clearer, and More Modular +4 itazap, ariG23498, ArthurZ, sergiopaniego, merve, pcuenq • Dec 18, 2025 • 125