One-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining
Paper • 2606.30634 • Published • 20
Daniil Tikhonov
perkyfever
·
AI & ML interests
None yet
Recent Activity
updated a model about 19 hours ago
ai-sage/GFusion-10B-A1.8B updated a model about 20 hours ago
ai-sage/GFusion-10B-A1.8B-bf16 updated a model about 20 hours ago
ai-sage/GFusion-10B-A1.8B-baseOrganizations
upvoted a paper 2 days ago