Kwaipilot/KAT-Coder-V2.5-Dev
Text Generation • 35B • Updated • 396 • 125
🦀 dancing crab
Damien
el4
AI & ML interests
I do anything really | #quantwizard | ETH: 0xDEE7fa8C421BD038D32e4441ea1aDe72fE973706
Recent Activity
new activity about 5 hours ago
Kwaipilot/KAT-Coder-V2.5-Dev:MTP support? Why no Vision? liked a model about 5 hours ago
Kwaipilot/KAT-Coder-V2.5-Dev updated a dataset 1 day ago
el4/testOrganizations
None yet
MTP support? Why no Vision?
10
#3 opened 1 day ago
by 
unoid
liked a
model about 5 hours ago
updated a
dataset 1 day ago
95% intelligence retained? how about 100% BS
❤️🔥 7
17
#36 opened 5 days ago
by 
aaron-newsome
we all know why you actually build this 😭
reacted to OppaAI's post with 😔 1 day ago
Post
3111
Try to chat with my AI Waifu in Japanese
Now that I have setup my AI Waifu running 24/7 in my Jetson Orin Nano (running at 25W top), I can talk to her anytime anywhere I want, on cellphone, tablet, or PC, as long as there is internet access.
Tonight I gave it a try to speak with my AI Waifu, with my not so great Japanese, just to test if ASR can pick up my Nihongo and the TTS can speak out Waifu's Japanese dialogue properly.
Turns out she is just as verbose and as heavily leaked with materials from system prompt as in English. Only this time I cannot fully understand.
I need to find some way to turn her into my Japanese tutor...
GitHub 🔗: https://github.com/OppaAI/Aiko-chan/
Now that I have setup my AI Waifu running 24/7 in my Jetson Orin Nano (running at 25W top), I can talk to her anytime anywhere I want, on cellphone, tablet, or PC, as long as there is internet access.
Tonight I gave it a try to speak with my AI Waifu, with my not so great Japanese, just to test if ASR can pick up my Nihongo and the TTS can speak out Waifu's Japanese dialogue properly.
Turns out she is just as verbose and as heavily leaked with materials from system prompt as in English. Only this time I cannot fully understand.
I need to find some way to turn her into my Japanese tutor...
GitHub 🔗: https://github.com/OppaAI/Aiko-chan/
- 5 replies
liked a
Space 3 days ago
reacted to SeaWolf-AI's post with 🔥 4 days ago
Post
5113
A small gift for anyone building or studying foundation models.
Most "open" models hand you the weights and stop there. With Aether-7B-5Attn we wanted to hand over the whole thing — so you can actually learn from it, reproduce it, and build on it: the data recipe, the training code, every hyperparameter, the complete logs, and the intermediate checkpoints. All Apache-2.0, reproducible byte-for-byte.
What you can do with it:
🔁 Rebuild it from scratch, or fork the recipe for your own model
🔬 Study a real heterogeneous-attention MoE — 49 layers place 5 attention mechanisms on a 7×7 Latin square, arranged as a clean, attributable ablation
📈 Trace training dynamics across the released checkpoints (110k / 115k / 162k)
It's a modest 6.59B model, and an honest one — the limitations (no KV-cache in this build, small scale) are written right in the card. We're not claiming it's special. If any piece of it saves you time or teaches you something, that's exactly what we hoped for. 🤗
📖 Full write-up →
[blog] · https://huggingface.co/blog/FINAL-Bench/opensource-llm
📦 5 Attention Base · FINAL-Bench/Aether-7B-5Attn
🎯 5 Attention Instruct · FINAL-Bench/Aether-7B-5Attn-it
🚀 5 Attention Live demo · FINAL-Bench/Aether-Sovereign-AI
📦 7 Attention Base · https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base
📦 11 Attention Base · FINAL-Bench/Aether-6B-11Attn-base
🧬 Collection · https://huggingface.co/collections/FINAL-Bench/aether-foundation-model
#opensource #LLM #MoE #reproducibility #Apache2
Most "open" models hand you the weights and stop there. With Aether-7B-5Attn we wanted to hand over the whole thing — so you can actually learn from it, reproduce it, and build on it: the data recipe, the training code, every hyperparameter, the complete logs, and the intermediate checkpoints. All Apache-2.0, reproducible byte-for-byte.
What you can do with it:
🔁 Rebuild it from scratch, or fork the recipe for your own model
🔬 Study a real heterogeneous-attention MoE — 49 layers place 5 attention mechanisms on a 7×7 Latin square, arranged as a clean, attributable ablation
📈 Trace training dynamics across the released checkpoints (110k / 115k / 162k)
It's a modest 6.59B model, and an honest one — the limitations (no KV-cache in this build, small scale) are written right in the card. We're not claiming it's special. If any piece of it saves you time or teaches you something, that's exactly what we hoped for. 🤗
📖 Full write-up →
[blog] · https://huggingface.co/blog/FINAL-Bench/opensource-llm
📦 5 Attention Base · FINAL-Bench/Aether-7B-5Attn
🎯 5 Attention Instruct · FINAL-Bench/Aether-7B-5Attn-it
🚀 5 Attention Live demo · FINAL-Bench/Aether-Sovereign-AI
📦 7 Attention Base · https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base
📦 11 Attention Base · FINAL-Bench/Aether-6B-11Attn-base
🧬 Collection · https://huggingface.co/collections/FINAL-Bench/aether-foundation-model
#opensource #LLM #MoE #reproducibility #Apache2
- 5 replies
upvoted an article 5 days ago
Article
Aether-7B-5Attn: A 100% Open-Source Sovereign Foundation Model — and a Controlled Experiment in Heterogeneous Attention
FINAL-Bench
• • 21 published a
dataset 5 days ago
liked a
dataset 5 days ago
Amazing work! 🔥
5
#1 opened 7 days ago
by el4
updated a
model 6 days ago
liked a
model 6 days ago
liked 2
datasets 6 days ago
updated a
collection 6 days ago
published a
model 6 days ago
liked a
dataset 6 days ago
updated a
collection 7 days ago