124M-Base-Experiments Checkpoints from my first 124M LLM pre-training project, covering scratch training, continued pre-training, and SFT experiments. mrinaalarora/mrinaal-124m-base Updated May 12 mrinaalarora/mrinaal-124m-base-v2 0.1B • Updated May 12 mrinaalarora/mrinaal-124m-instruct-smoltalk-50k 0.1B • Updated May 12 mrinaalarora/mrinaal-124m-base-v3-mathmix 0.1B • Updated May 14
Nanbeige4-3B Cold Start Reasoning LoRA Experiments Two LoRA cold-start SFT experiments teaching structured think/answer reasoning to Nanbeige4-3B-Base using distilled traces from frontier models mrinaalarora/nanbeige4-3b-cold-start-reasoning-lora-glm-12k Text Generation • Updated Mar 10 • 1 mrinaalarora/Nanbeige4-3B-Cold-Start-Reasoning-LoRA Text Generation • Updated Mar 2 • 2 mrinaalarora/Nanbeige4-3B-Cold-Start-Reasoning-LoRA-Opus-Epoch3 Text Generation • Updated Mar 13 • 4
124M-Base-Experiments Checkpoints from my first 124M LLM pre-training project, covering scratch training, continued pre-training, and SFT experiments. mrinaalarora/mrinaal-124m-base Updated May 12 mrinaalarora/mrinaal-124m-base-v2 0.1B • Updated May 12 mrinaalarora/mrinaal-124m-instruct-smoltalk-50k 0.1B • Updated May 12 mrinaalarora/mrinaal-124m-base-v3-mathmix 0.1B • Updated May 14
Nanbeige4-3B Cold Start Reasoning LoRA Experiments Two LoRA cold-start SFT experiments teaching structured think/answer reasoning to Nanbeige4-3B-Base using distilled traces from frontier models mrinaalarora/nanbeige4-3b-cold-start-reasoning-lora-glm-12k Text Generation • Updated Mar 10 • 1 mrinaalarora/Nanbeige4-3B-Cold-Start-Reasoning-LoRA Text Generation • Updated Mar 2 • 2 mrinaalarora/Nanbeige4-3B-Cold-Start-Reasoning-LoRA-Opus-Epoch3 Text Generation • Updated Mar 13 • 4
