Our Tiny Model Family
AI & ML interests
Small Logic Engines
Recent Activity
Organization Card
Axiomic Labs is an independent, Australian based, AI research lab. Our work explores how small models can achieve stronger capabilities through better training data, compact architectures, and targeted benchmarks.
Latest releases
Models
- GPT-S2-5M - The latest and most capable member of GPT-S family, featuring our latest T-X4 architecture and achieving #1 on the open SLM leaderboard sub 10m category.
- GPT-S-1.4M - The tiniest member of our small model GPT-S family, featuring our T-X3 architecture.
- GPT-X2-125M - Our flagship language model featuring our second-generation T-X2 architecture and achieving near state-of-the-art performance at the 125M scale.
Benchmarks
- ArithMark-2.0 - An updated version of our Arithmetic Benchmark, featuring improvements across the board
Datasets
- NPset-2-Python-Edu - Our latest Natural language code dataset, converted from stack-edu (python split), parsed using the all new NPset-2 spec
Other
- Open SLM Leaderboard - A leaderboard for Small language models (<150m parameters) scored on 5 hand picked benchmarks. See how our models stack up against our competitors.
Visit our website: https://www.axiomiclabs.com
models 6
AxiomicLabs/GPT-S2-5M
Text Generation • 5.38M • Updated • 7
AxiomicLabs/GPT-S-1.4M
Text Generation • 1.43M • Updated • 264 • 6
AxiomicLabs/GPT-X-125M
Text Generation • 0.1B • Updated • 294 • 3
AxiomicLabs/GPT-S-5M
Text Generation • 5.16M • Updated • 1.96k • 12
AxiomicLabs/GPT-X2-125M
Text Generation • 0.1B • Updated • 1.02k • 16
AxiomicLabs/GPT-X2-TOK-32K
Updated • 1