OppaAI
OppaAI
AI & ML interests
Local AI implementation, Agentic AI workflows, AI Autonomous Robot
Recent Activity
repliedto their post about 8 hours ago
Another new small agentic model comes out:
https://huggingface.co/Nanbeige/Nanbeige4.2-3B
Nanbeige4.2-3B that claims to beat the likes of Gemma4-E4B and Qwen3.5 9B.
Gonna test this model in the weekend.
Tested many small LLM <4B in Jetson Orin Nano, the followings are the one I would consider:
Ministral3-3B - Best overall with tool-calling, vision and tons of hallucinations (currently using)
MiniCPM-V-4.6 1.3B - Good VLM, lacking in chatting/tool-calling
Granite4.1-3B - slightly better at agentic tool-calling, faster inference speed
Bonsai 8B Q1 - better at agentic tool-calling, similar speed as Ministral3-3B
Bonsai 27B Q1 - better than 8B but way too slow
Needle 26M - only use for query generation and tool execution, needs JAX
Nanbeige4.2-3B - TBD
repliedto their post about 8 hours ago
Try to chat with my AI Waifu in Japanese
Now that I have setup my AI Waifu running 24/7 in my Jetson Orin Nano (running at 25W top), I can talk to her anytime anywhere I want, on cellphone, tablet, or PC, as long as there is internet access.
Tonight I gave it a try to speak with my AI Waifu, with my not so great Japanese, just to test if ASR can pick up my Nihongo and the TTS can speak out Waifu's Japanese dialogue properly.
Turns out she is just as verbose and as heavily leaked with materials from system prompt as in English. Only this time I cannot fully understand.
I need to find some way to turn her into my Japanese tutor...
GitHub 🔗: https://github.com/OppaAI/Aiko-chan/Organizations
