Hugging Face's logo
Mr Munk's picture
🔄 In a Training Loop

Mr Munk

GODELEV
41 3 49
AxionLab-official's profile picture Metris's profile picture Jdudeo's profile picture
·

AI & ML interests

High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.

Recent Activity

reacted to Enderchef's post with ❤️ 25 minutes ago
I've left Glint Research. After a long time in Glint Research, an entire distributed training grid built free for them, and more, I've decided that I no longer want to be affiliated with Glint Research. More updates will follow. Comments/questions are welcome. While you're reading this, follow these orgs! Following takes just a few seconds, and can change someone's day. https://huggingface.co/AxiomicLabs https://huggingface.co/fromziro https://huggingface.co/SupraLabs
repliedto Banaxi-Tech's post about 10 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release https://huggingface.co/BananaMind @Banaxi-Tech
repliedto Banaxi-Tech's post about 10 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release https://huggingface.co/BananaMind @Banaxi-Tech
View all activity

Organizations

BananaMind Model Previewers's profile picture