Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated Sep 22 • 83 • 4 open-lm-engine/rigel-base-long Text Generation • 2B • Updated Sep 22 • 65 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated Sep 22 • 57 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 10 • 2 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 25 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 14 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 10 • 1
Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated Sep 22 • 83 • 4 open-lm-engine/rigel-base-long Text Generation • 2B • Updated Sep 22 • 65 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated Sep 22 • 57 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 10 • 2 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 25 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 14 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 10 • 1