google
/

gemma-scope-2b-pt-res

Model card Files Files and versions

gemma-scope-2b-pt-res / embedding

302 MB

5 contributors

History: 2 commits

Tom Lieberum

fold in scaling by sqrt(d_model) into params

9ff4e7b about 1 year ago

width_4k
fold in scaling by sqrt(d_model) into params about 1 year ago