fromziro/Er-Large-30M
31.9M • Updated • 6 • 3
🔄 In a Training Loop
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a model about 13 hours ago
fromziro/Er-Large-30M repliedto Banaxi-Tech's post about 22 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
https://huggingface.co/BananaMind
@Banaxi-Tech
new activity about 23 hours ago
CyanMonkey/Testing-v2:Delete benchmark_booster_train.txtOrganizations
liked a
model about 13 hours ago
liked a
dataset 3 days ago
liked 2
models 4 days ago
liked a
dataset 5 days ago
liked a
model 5 days ago
liked a
Space 7 days ago
liked a
dataset 7 days ago
liked a
model 7 days ago
liked a
dataset 13 days ago
liked a
model 18 days ago
liked a
model 21 days ago
liked a
model 22 days ago
liked a
dataset 23 days ago
liked a
model 24 days ago
liked 4
datasets 25 days ago
liked a
model 26 days ago