Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated 1 day ago • 406 • 3 open-lm-engine/rigel-base-long Text Generation • 2B • Updated 1 day ago • 552 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated 1 day ago • 98 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 4 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 17 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 9 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 7 • 1
Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated 1 day ago • 406 • 3 open-lm-engine/rigel-base-long Text Generation • 2B • Updated 1 day ago • 552 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated 1 day ago • 98 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 4 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 17 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 9 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 7 • 1