amazon/ALoDLM-8B
Text Generation ā¢ 8B ā¢ Updated ā¢ 1.19k ā¢ 52
Carlo Moro PRO
cnmoro
AI & ML interests
Retrieval & Small Models & PTBR Resources
Recent Activity
liked a model about 11 hours ago
amazon/ALoDLM-8B liked a model about 21 hours ago
nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-GGUF upvoted a collection 2 days ago
UltraBERTOrganizations
liked a
model about 11 hours ago
liked a
model about 21 hours ago
upvoted a collection 2 days ago
liked a
model 4 days ago
liked a
model 7 days ago
liked a
model 9 days ago
liked a
model 11 days ago
reacted to SeaWolf-AI's post with ā¤ļø 14 days ago
Post
6,246
š» Data-center AI, now on a laptop: POCKET-Darwin-180B
We're releasing a 4-bit GGUF build of Darwin-180B-RSI, #1 on seven official Hugging Face leaderboards (self-reported), that runs without a GPU.
š¦ 360 GB ā 111 GB (4-bit GGUF, 4 files)
š„ļø No GPU: one server CPU (16 threads) at 18.4ā21.0 tokens/s
š» RTX 5060 laptop (8 GB VRAM) + 32 GB RAM: 4.17 tokens/s
š§ 128 GB mini PC: whole model in memory, no GPU needed
šÆ MMLU-Pro, 2,000 questions, paired: original 87.65% = 4-bit 87.65%
How?
Ā· Only ~3B of 180B parameters are active per token (10 of 512 experts)
Ā· llama.cpp streams just the needed experts from SSD, so 32 GB RAM is enough
Ā· Graft quantization: we took the proven Unsloth UD-Q4_K_XL base build and swapped in only the 300 tensors our RSI training changed (300/300 verified)
Under the hood is Model-level Recursive Self-Improvement. The model solves verifiable problems, keeps only its own solutions that check out as correct, and trains on them. No human-written solutions or reasoning traces.
Built for teams that can't send data to an external cloud (defense, finance, public sector) to run a top-tier model fully offline.
š Article: https://huggingface.co/blog/FINAL-Bench/data-center-ai-now-on-a-laptop-pocket-darwin-180b
š¤ Model: FINAL-Bench/POCKET-Darwin-180B-GGUF
š§¬ Original: FINAL-Bench/Darwin-180B-RSI
#Darwin #RSI #GGUF #llamacpp #OnDevice #MoE
We're releasing a 4-bit GGUF build of Darwin-180B-RSI, #1 on seven official Hugging Face leaderboards (self-reported), that runs without a GPU.
š¦ 360 GB ā 111 GB (4-bit GGUF, 4 files)
š„ļø No GPU: one server CPU (16 threads) at 18.4ā21.0 tokens/s
š» RTX 5060 laptop (8 GB VRAM) + 32 GB RAM: 4.17 tokens/s
š§ 128 GB mini PC: whole model in memory, no GPU needed
šÆ MMLU-Pro, 2,000 questions, paired: original 87.65% = 4-bit 87.65%
How?
Ā· Only ~3B of 180B parameters are active per token (10 of 512 experts)
Ā· llama.cpp streams just the needed experts from SSD, so 32 GB RAM is enough
Ā· Graft quantization: we took the proven Unsloth UD-Q4_K_XL base build and swapped in only the 300 tensors our RSI training changed (300/300 verified)
Under the hood is Model-level Recursive Self-Improvement. The model solves verifiable problems, keeps only its own solutions that check out as correct, and trains on them. No human-written solutions or reasoning traces.
Built for teams that can't send data to an external cloud (defense, finance, public sector) to run a top-tier model fully offline.
š Article: https://huggingface.co/blog/FINAL-Bench/data-center-ai-now-on-a-laptop-pocket-darwin-180b
š¤ Model: FINAL-Bench/POCKET-Darwin-180B-GGUF
š§¬ Original: FINAL-Bench/Darwin-180B-RSI
#Darwin #RSI #GGUF #llamacpp #OnDevice #MoE
- 30 replies
liked a
Space 17 days ago
liked 2
models 22 days ago
liked a
model 23 days ago
liked a
model 24 days ago
liked a
model 25 days ago
liked a
model 29 days ago
liked 5
models about 1 month ago
nickprock/granite-311m-italiano-matryoshka
Sentence Similarity ā¢ 0.3B ā¢ Updated ā¢ 348 ā¢ 5
ukisai/Swift-Qwen3.8-27B-GGUF
Image-Text-to-Text ā¢ 27B ā¢ Updated ā¢ 493k ā¢ 466
deepgrove/maple-preview
Text Generation ā¢ 20B ā¢ Updated ā¢ 1.67k ā¢ 424
bartowski/Qwen3.8-27B-GGUF
Image-Text-to-Text ā¢ 27B ā¢ Updated ā¢ 459k ā¢ 207
IFM/K2-Horizon-7B-GGUF
Text Generation ā¢ 9B ā¢ Updated ā¢ 33.5k ā¢ 76