Post
590
what should i make next?
Join the conversation
Join the community of Machine Learners and AI enthusiasts.
Sign Up
You should grug-ify ornith 1.5 35b a3b.
Ornith is cranking out bangers, there would be huge demand for a MOE v1.1 with Ornith level performance, and maybe a working MTP head.
You could also do a smaller model for the GPU weak, like ling or lfm2.5, that doesn't move at a snail's pace (they both are MOE, and overthink)
Grug 35b v1 didn’t get that much demand even though it was based off ornith 1 but I might do this! Thanks for suggestion
Grug 27B 2.0 would be cool!
@ProCreations just out of curiosity, what optimizer do you usually use to train your ais? i use Muon