My series of fully open, state-of-the-art small mixture-of-experts models.
🔄 In a Training Loop
aquilesfd
aquilesfd
AI & ML interests
research
Recent Activity
liked a model 37 minutes ago
XiaomiMiMo/MiMo-V2.6-Pro-RL liked a model about 3 hours ago
Altworld/Hemmingway-1 repliedto Datdanboi25's post about 21 hours ago
THE SLM FRONTIER ADVANCES!
https://huggingface.co/bench-labs/cagliostro-v3 just hit an Intelligence Index of 26.13 on the https://huggingface.co/spaces/AxiomicLabs/Open_SLM_Leaderboard a 146M-param model trained completely from scratch on a single consumer GPU. That's 2nd place overall, and as far as I can tell, the most capable SLM trained on consumer hardware to date. Beating SmolLM-135m on 1/8th of the data is just silly levels of efficiency.
Big congrats to the @BenchLabs team and specifically @TobiasLogic !
Organizations
models 8
aquilesfd/neo-3-1B-A90M-Instruct
Text Generation • Updated • 12
aquilesfd/neo-3-3B-A400M-Thinking
Text Generation • Updated • 7
aquilesfd/neo-3-1B-A90M-Base
Text Generation • 1.0B • Updated • 399 • 8
aquilesfd/neo-3-3B-A400M-Base
Text Generation • 3B • Updated • 339 • 8
aquilesfd/neo-2-345M-C2
Text Generation • 0.4B • Updated • 36 • 1
aquilesfd/neo-2-345M-C1
Text Generation • 0.4B • Updated • 43 • 1
aquilesfd/neo-64M-C1
Text Generation • 64.1M • Updated • 38
aquilesfd/VLM-MoE-3x124M-Experiment
0.4B • Updated • 17