Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Julian Minder
jkminder
AI & ML interests
None yet
Recent Activity
updated a model about 12 hours ago
jkminder/d20_477m_seed4_sft updated a model about 12 hours ago
jkminder/d20_477m_seed3_sft updated a model about 12 hours ago
jkminder/d20_477m_seed1_sftOrganizations
Scaling Ladder (optimized) — 3 sizes, 286M–897M, 200 TPP
Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP
The whole ladder, 200 TPP on ClimbMix; plain GPT (nanochat mechanisms disabled). Bases, then chat-SFTs (_sft).
models 176
jkminder/d20_477m_seed4_sft
Text Generation • 0.5B • Updated • 181
jkminder/d20_477m_seed3_sft
Text Generation • 0.5B • Updated • 183
jkminder/d20_477m_seed1_sft
Text Generation • 0.5B • Updated • 204
jkminder/d20_477m_seed2_sft
Text Generation • 0.5B • Updated • 187
jkminder/d26_973m_seed4_sft
Text Generation • 1.0B • Updated • 198
jkminder/d26_973m_seed3_sft
Text Generation • 1.0B • Updated • 178
jkminder/d26_973m_seed1_sft
Text Generation • 1.0B • Updated • 189
jkminder/d26_973m_seed2_sft
Text Generation • 1.0B • Updated • 168
jkminder/d12_135m_seed4_sft
Text Generation • 0.1B • Updated • 464
jkminder/d12_135m_seed3_sft
Text Generation • 0.1B • Updated • 445
datasets 15
jkminder/pretraining-priors-pirate-register
Viewer • Updated • 999k • 132
jkminder/normative-reflections-feedback
Viewer • Updated • 5 • 5
jkminder/apertus-annotation-feedback
Viewer • Updated • 52 • 2
jkminder/model-raising-interp-prepared
Viewer • Updated • 100k • 19
jkminder/model-raising-pbsft-eval
Viewer • Updated • 9.99k • 21
jkminder/model-raising-reflection-end-eval
Viewer • Updated • 28.7k • 14
jkminder/model-raising-pb-300k-3c-sft
Viewer • Updated • 302k • 9
jkminder/or-bench-1k-overrefusal
Viewer • Updated • 962 • 34
jkminder/xstest-overrefusal
Viewer • Updated • 214 • 40
jkminder/orfuzz
Viewer • Updated • 1.79k • 8