Models
Datasets
Spaces
Docs
Enterprise
免费去水印
Log In
Sign Up

StepLaw

community

https://step-law.github.io/

step-law

Activity Feed Request to join this org

AI & ML interests

None defined yet.

StepLaw 's collections 41

StepLaw-N_59M-D_7.0B

Models with 59M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS1048576

Text Generation • 0.1B • Updated Apr 15 • 10

StepLaw-N_59M-D_1.0B

Models with 59M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS2097152

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 7

StepLaw-N_536M-D_7.0B

Models with 536M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_536M-D_7.0B-LR6.905e-04-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_3.0B

Models with 536M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_536M-D_3.0B-LR5.524e-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_3.0B-LR6.905e-04-BS65536

Text Generation • 0.7B • Updated Apr 15 • 10
StepLaw/StepLaw-N_536M-D_3.0B-LR9.766e-04-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7

StepLaw-N_536M-D_19.0B

Models with 536M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_536M-D_19.0B-LR3.906e-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_19.0B-LR5.524e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_19.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_429M-D_99.0B

Models with 429M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_429M-D_99.0B-LR3.906e-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS1048576

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_49.0B

Models with 429M parameters trained with 49.0B tokens.

StepLaw/StepLaw-N_429M-D_49.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_49.0B-LR1.381e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_49.0B-LR3.906e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_49.0B-LR1.105e-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_3.0B

Models with 429M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_429M-D_3.0B-LR6.905e-04-BS131072

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_3.0B-LR9.766e-04-BS131072

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_3.0B-LR1.381e-03-BS32768

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_429M-D_19.0B

Models with 429M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_429M-D_19.0B-LR4.883e-04-BS131072

Text Generation • 0.6B • Updated Apr 15
StepLaw/StepLaw-N_429M-D_19.0B-LR4.883e-04-BS1572864

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_19.0B-LR5.524e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_268M-D_99.0B

Models with 268M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_268M-D_99.0B-LR7.812e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR9.766e-04-BS524288

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR1.381e-03-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_7.0B

Models with 268M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_268M-D_7.0B-LR2.762e-03-BS1048576

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 13
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_3.0B

Models with 268M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS131072

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR6.905e-04-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_19.0B

Models with 268M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 9
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS1048576

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS131072

Text Generation • 0.4B • Updated Apr 15 • 10

StepLaw-N_268M-D_1.0B

Models with 268M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 9
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 10

StepLaw-N_214M-D_7.0B

Models with 214M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.3B • Updated Apr 15 • 9
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 0.3B • Updated Apr 15 • 6

StepLaw-N_214M-D_3.0B

Models with 214M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 9

StepLaw-N_214M-D_1.0B

Models with 214M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.3B • Updated Apr 15 • 5
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.3B • Updated Apr 15 • 6

StepLaw-N_119M-D_3.0B

Models with 119M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS524288

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS65536

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 8

StepLaw-N_1.0B-D_7.0B

Models with 1.0B parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 1B • Updated Apr 15 • 7

StepLaw-N_1.0B-D_3.0B

Models with 1.0B parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS32768

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 6

StepLaw-N_1.0B-D_1.0B

Models with 1.0B parameters trained with 1.0B tokens. Architecture: H=2048, FFN=8192, Heads=16, Layers=16.

StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS32768

Text Generation • 1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 7

StepLaw-N_59M-D_3.0B

Models with 59M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 11
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS1048576

Text Generation • 0.1B • Updated Apr 15 • 6

StepLaw-N_536M-D_9.0B

Models with 536M parameters trained with 9.0B tokens.

StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS2097152

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS262144

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS393216

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS4194304

Text Generation • 0.7B • Updated Apr 15 • 6

StepLaw-N_536M-D_49.0B

Models with 536M parameters trained with 49.0B tokens.

StepLaw/StepLaw-N_536M-D_49.0B-LR1.11E-02-BS65536

Text Generation • 0.7B • Updated Apr 15 • 6
StepLaw/StepLaw-N_536M-D_49.0B-LR1.95E-03-BS1507328

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_49.0B-LR5.52E-03-BS2097152

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_49.0B-LR5.52E-03-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_28.0B

Models with 536M parameters trained with 28.0B tokens.

StepLaw/StepLaw-N_536M-D_28.0B-LR1.56E-02-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_28.0B-LR1.95E-03-BS393216

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_28.0B-LR1.95E-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_28.0B-LR3.91E-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_1.0B

Models with 536M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_536M-D_1.0B-LR3.906e-03-BS32768

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 6
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 10

StepLaw-N_429M-D_7.0B

Models with 429M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_429M-D_7.0B-LR1.105e-02-BS524288

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_7.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_7.0B-LR1.381e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_7.0B-LR1.562e-02-BS4194304

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_429M-D_39.0B

Models with 429M parameters trained with 39.0B tokens.

StepLaw/StepLaw-N_429M-D_39.0B-LR3.91E-03-BS65536

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS393216

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_22.0B

Models with 429M parameters trained with 22.0B tokens.

StepLaw/StepLaw-N_429M-D_22.0B-LR1.95E-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_22.0B-LR6.91E-04-BS4194304

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_22.0B-LR1.11E-02-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 8
StepLaw/StepLaw-N_429M-D_22.0B-LR1.11E-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 9

StepLaw-N_429M-D_1.0B

Models with 429M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.6B • Updated Apr 15 • 7

StepLaw-N_268M-D_79.0B

Models with 268M parameters trained with 79.0B tokens.

StepLaw/StepLaw-N_268M-D_79.0B-LR1.953e-03-BS1507328

Text Generation • 0.4B • Updated Apr 15 • 11
StepLaw/StepLaw-N_268M-D_79.0B-LR2.441e-04-BS524288

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_79.0B-LR6.905e-04-BS131072

Text Generation • 0.4B • Updated Apr 15 • 49
StepLaw/StepLaw-N_268M-D_79.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_4.0B

Models with 268M parameters trained with 4.0B tokens.

StepLaw/StepLaw-N_268M-D_4.0B-LR1.105e-02-BS65536

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_4.0B-LR2.762e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 5
StepLaw/StepLaw-N_268M-D_4.0B-LR4.883e-04-BS1507328

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_4.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_24.0B

Models with 268M parameters trained with 24.0B tokens.

StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS262144

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS32768

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS393216

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_14.0B

Models with 268M parameters trained with 14.0B tokens.

StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS393216

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS4194304

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_214M-D_99.0B

Models with 214M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 8

StepLaw-N_214M-D_19.0B

Models with 214M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS32768

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 7

StepLaw-N_214M-D_11.0B

Models with 214M parameters trained with 11.0B tokens.

StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 7

StepLaw-N_119M-D_7.0B

Models with 119M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.2B • Updated Apr 15 • 8
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 8

StepLaw-N_119M-D_1.0B

Models with 119M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS2097152

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS262144

Text Generation • 0.2B • Updated Apr 15 • 9
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS524288

Text Generation • 0.2B • Updated Apr 15 • 6
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 6

StepLaw-N_1.0B-D_56.0B

Models with 1.0B parameters trained with 56.0B tokens.

StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS2097152

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS393216

Text Generation • 1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS4194304

Text Generation • 1B • Updated Apr 15 • 7

StepLaw-N_1.0B-D_19.0B

Models with 1.0B parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS2097152

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS262144

Text Generation • 1B • Updated Apr 15 • 10
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS393216

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS4194304

Text Generation • 1B • Updated Apr 15 • 9

StepLaw-N_59M-D_7.0B

Models with 59M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_59M-D_7.0B-LR1.105e-02-BS1048576

Text Generation • 0.1B • Updated Apr 15 • 10

StepLaw-N_59M-D_3.0B

Models with 59M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 11
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_59M-D_3.0B-LR1.105e-02-BS1048576

Text Generation • 0.1B • Updated Apr 15 • 6

StepLaw-N_59M-D_1.0B

Models with 59M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS2097152

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS262144

Text Generation • 0.1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS524288

Text Generation • 0.1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_59M-D_1.0B-LR1.105e-02-BS65536

Text Generation • 0.1B • Updated Apr 15 • 7

StepLaw-N_536M-D_9.0B

Models with 536M parameters trained with 9.0B tokens.

StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS2097152

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS262144

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS393216

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_9.0B-LR1.105e-02-BS4194304

Text Generation • 0.7B • Updated Apr 15 • 6

StepLaw-N_536M-D_7.0B

Models with 536M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_536M-D_7.0B-LR6.905e-04-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_49.0B

Models with 536M parameters trained with 49.0B tokens.

StepLaw/StepLaw-N_536M-D_49.0B-LR1.11E-02-BS65536

Text Generation • 0.7B • Updated Apr 15 • 6
StepLaw/StepLaw-N_536M-D_49.0B-LR1.95E-03-BS1507328

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_49.0B-LR5.52E-03-BS2097152

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_49.0B-LR5.52E-03-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_3.0B

Models with 536M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_536M-D_3.0B-LR5.524e-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_3.0B-LR6.905e-04-BS65536

Text Generation • 0.7B • Updated Apr 15 • 10
StepLaw/StepLaw-N_536M-D_3.0B-LR9.766e-04-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7

StepLaw-N_536M-D_28.0B

Models with 536M parameters trained with 28.0B tokens.

StepLaw/StepLaw-N_536M-D_28.0B-LR1.56E-02-BS1048576

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_28.0B-LR1.95E-03-BS393216

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_28.0B-LR1.95E-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_28.0B-LR3.91E-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_19.0B

Models with 536M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_536M-D_19.0B-LR3.906e-03-BS131072

Text Generation • 0.7B • Updated Apr 15 • 5
StepLaw/StepLaw-N_536M-D_19.0B-LR5.524e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 9
StepLaw/StepLaw-N_536M-D_19.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 8

StepLaw-N_536M-D_1.0B

Models with 536M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_536M-D_1.0B-LR3.906e-03-BS32768

Text Generation • 0.7B • Updated Apr 15 • 7
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.7B • Updated Apr 15 • 6
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.7B • Updated Apr 15 • 8
StepLaw/StepLaw-N_536M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.7B • Updated Apr 15 • 10

StepLaw-N_429M-D_99.0B

Models with 429M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_429M-D_99.0B-LR3.906e-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_99.0B-LR1.381e-03-BS1048576

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_7.0B

Models with 429M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_429M-D_7.0B-LR1.105e-02-BS524288

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_7.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_7.0B-LR1.381e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_7.0B-LR1.562e-02-BS4194304

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_429M-D_49.0B

Models with 429M parameters trained with 49.0B tokens.

StepLaw/StepLaw-N_429M-D_49.0B-LR1.381e-03-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_49.0B-LR1.381e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_49.0B-LR3.906e-03-BS720896

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_49.0B-LR1.105e-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_39.0B

Models with 429M parameters trained with 39.0B tokens.

StepLaw/StepLaw-N_429M-D_39.0B-LR3.91E-03-BS65536

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_39.0B-LR1.11E-02-BS393216

Text Generation • 0.6B • Updated Apr 15 • 8

StepLaw-N_429M-D_3.0B

Models with 429M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_429M-D_3.0B-LR6.905e-04-BS131072

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_3.0B-LR9.766e-04-BS131072

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_3.0B-LR1.381e-03-BS32768

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_429M-D_22.0B

Models with 429M parameters trained with 22.0B tokens.

StepLaw/StepLaw-N_429M-D_22.0B-LR1.95E-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_22.0B-LR6.91E-04-BS4194304

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_22.0B-LR1.11E-02-BS2097152

Text Generation • 0.6B • Updated Apr 15 • 8
StepLaw/StepLaw-N_429M-D_22.0B-LR1.11E-02-BS262144

Text Generation • 0.6B • Updated Apr 15 • 9

StepLaw-N_429M-D_19.0B

Models with 429M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_429M-D_19.0B-LR4.883e-04-BS131072

Text Generation • 0.6B • Updated Apr 15
StepLaw/StepLaw-N_429M-D_19.0B-LR4.883e-04-BS1572864

Text Generation • 0.6B • Updated Apr 15 • 9
StepLaw/StepLaw-N_429M-D_19.0B-LR5.524e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 4
StepLaw/StepLaw-N_429M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6

StepLaw-N_429M-D_1.0B

Models with 429M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.6B • Updated Apr 15 • 6
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.6B • Updated Apr 15 • 7
StepLaw/StepLaw-N_429M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.6B • Updated Apr 15 • 7

StepLaw-N_268M-D_99.0B

Models with 268M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_268M-D_99.0B-LR7.812e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR9.766e-04-BS524288

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR1.381e-03-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_99.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_79.0B

Models with 268M parameters trained with 79.0B tokens.

StepLaw/StepLaw-N_268M-D_79.0B-LR1.953e-03-BS1507328

Text Generation • 0.4B • Updated Apr 15 • 11
StepLaw/StepLaw-N_268M-D_79.0B-LR2.441e-04-BS524288

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_79.0B-LR6.905e-04-BS131072

Text Generation • 0.4B • Updated Apr 15 • 49
StepLaw/StepLaw-N_268M-D_79.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_7.0B

Models with 268M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_268M-D_7.0B-LR2.762e-03-BS1048576

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 13
StepLaw/StepLaw-N_268M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_4.0B

Models with 268M parameters trained with 4.0B tokens.

StepLaw/StepLaw-N_268M-D_4.0B-LR1.105e-02-BS65536

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_4.0B-LR2.762e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 5
StepLaw/StepLaw-N_268M-D_4.0B-LR4.883e-04-BS1507328

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_4.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_3.0B

Models with 268M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR5.524e-03-BS131072

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_3.0B-LR6.905e-04-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8

StepLaw-N_268M-D_24.0B

Models with 268M parameters trained with 24.0B tokens.

StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS262144

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS32768

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_24.0B-LR1.11E-02-BS393216

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_19.0B

Models with 268M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 9
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS1048576

Text Generation • 0.4B • Updated Apr 15 • 7
StepLaw/StepLaw-N_268M-D_19.0B-LR1.381e-03-BS131072

Text Generation • 0.4B • Updated Apr 15 • 10

StepLaw-N_268M-D_14.0B

Models with 268M parameters trained with 14.0B tokens.

StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS2097152

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS262144

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS393216

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_14.0B-LR1.105e-02-BS4194304

Text Generation • 0.4B • Updated Apr 15 • 7

StepLaw-N_268M-D_1.0B

Models with 268M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.4B • Updated Apr 15 • 6
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.4B • Updated Apr 15 • 8
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.4B • Updated Apr 15 • 9
StepLaw/StepLaw-N_268M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.4B • Updated Apr 15 • 10

StepLaw-N_214M-D_99.0B

Models with 214M parameters trained with 99.0B tokens.

StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_99.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 8

StepLaw-N_214M-D_7.0B

Models with 214M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.3B • Updated Apr 15 • 9
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 0.3B • Updated Apr 15 • 6

StepLaw-N_214M-D_19.0B

Models with 214M parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS32768

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_19.0B-LR1.11E-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 7

StepLaw-N_214M-D_3.0B

Models with 214M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 7
StepLaw/StepLaw-N_214M-D_3.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 9

StepLaw-N_214M-D_11.0B

Models with 214M parameters trained with 11.0B tokens.

StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS2097152

Text Generation • 0.3B • Updated Apr 15 • 8
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS393216

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_11.0B-LR1.105e-02-BS4194304

Text Generation • 0.3B • Updated Apr 15 • 7

StepLaw-N_214M-D_1.0B

Models with 214M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS262144

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS32768

Text Generation • 0.3B • Updated Apr 15 • 6
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS524288

Text Generation • 0.3B • Updated Apr 15 • 5
StepLaw/StepLaw-N_214M-D_1.0B-LR1.381e-03-BS65536

Text Generation • 0.3B • Updated Apr 15 • 6

StepLaw-N_119M-D_7.0B

Models with 119M parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS262144

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS524288

Text Generation • 0.2B • Updated Apr 15 • 8
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS65536

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 8

StepLaw-N_119M-D_3.0B

Models with 119M parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS262144

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS524288

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS65536

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_3.0B-LR1.381e-03-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 8

StepLaw-N_119M-D_1.0B

Models with 119M parameters trained with 1.0B tokens.

StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS2097152

Text Generation • 0.2B • Updated Apr 15 • 7
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS262144

Text Generation • 0.2B • Updated Apr 15 • 9
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS524288

Text Generation • 0.2B • Updated Apr 15 • 6
StepLaw/StepLaw-N_119M-D_1.0B-LR1.105e-02-BS1048576

Text Generation • 0.2B • Updated Apr 15 • 6

StepLaw-N_1.0B-D_7.0B

Models with 1.0B parameters trained with 7.0B tokens.

StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 5
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_1.0B-D_7.0B-LR1.381e-03-BS1048576

Text Generation • 1B • Updated Apr 15 • 7

StepLaw-N_1.0B-D_56.0B

Models with 1.0B parameters trained with 56.0B tokens.

StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS2097152

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS393216

Text Generation • 1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_1.0B-D_56.0B-LR1.381e-03-BS4194304

Text Generation • 1B • Updated Apr 15 • 7

StepLaw-N_1.0B-D_3.0B

Models with 1.0B parameters trained with 3.0B tokens.

StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 8
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS32768

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_3.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 6

StepLaw-N_1.0B-D_19.0B

Models with 1.0B parameters trained with 19.0B tokens.

StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS2097152

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS262144

Text Generation • 1B • Updated Apr 15 • 10
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS393216

Text Generation • 1B • Updated Apr 15 • 7
StepLaw/StepLaw-N_1.0B-D_19.0B-LR1.105e-02-BS4194304

Text Generation • 1B • Updated Apr 15 • 9

StepLaw-N_1.0B-D_1.0B

Models with 1.0B parameters trained with 1.0B tokens. Architecture: H=2048, FFN=8192, Heads=16, Layers=16.

StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS262144

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS32768

Text Generation • 1B • Updated Apr 15 • 6
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS524288

Text Generation • 1B • Updated Apr 15 • 9
StepLaw/StepLaw-N_1.0B-D_1.0B-LR1.381e-03-BS65536

Text Generation • 1B • Updated Apr 15 • 7

Company

TOS Privacy About Careers

Website

Models Datasets 免费Z-image图片生成免费去水印 Vibevoice

🎉 Free Image Generator Now Available!

Totally Free + Zero Barriers + No Login Required