open-lm-engine/gdn-7b
7B • Updated • 42 • 1
M2RNN
Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models
-
-
open-lm-engine/m2rnn-7b
7B • Updated • 40 • 2 -
open-lm-engine/transformer-7b
7B • Updated • 25 • 1 -
open-lm-engine/hybrid-gdn-7b
7B • Updated • 90 • 1 -
open-lm-engine/hybrid-m2rnn-7b
7B • Updated • 21 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-7b
7B • Updated • 94 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-5l-7b
7B • Updated • 91 • 1 -
open-lm-engine/gdn-400m
0.4B • Updated • 4 • 1 -
open-lm-engine/m2rnn-400m
0.4B • Updated • 138 • 1 -
open-lm-engine/transformer-400m
0.4B • Updated • 6 • 1 -
open-lm-engine/hybrid-gdn-400m
0.4B • Updated • 6 • 2 -
open-lm-engine/hybrid-m2rnn-400m
0.4B • Updated • 8 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-400m
0.4B • Updated • 5 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-3l-400m
0.4B • Updated • 5 • 1