Hugging Face's logo

Xenova
/
codegen-350M-mono

Text Generation
Transformers.js
ONNX
codegen
Model card Files
xet
Community
6
whitphx HF Staff commited on
Commit
72abde2
·
verified ·
1 Parent(s): 2a09d54

Add/update the quantized ONNX model files and README.md for Transformers.js v3

Browse files

## Applied Quantizations

### ✅ Based on `decoder_model.onnx` *with* slimming

↳ ✅ `int8`: `decoder_model_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_model_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added)

### ✅ Based on `decoder_model.onnx` *with* slimming

↳ ✅ `int8`: `decoder_model_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_model_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added)

### ✅ Based on `decoder_with_past_model.onnx` *with* slimming

↳ ✅ `fp16`: `decoder_with_past_model_fp16.onnx` (added)
↳ ✅ `int8`: `decoder_with_past_model_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_with_past_model_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_with_past_model_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_with_past_model_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_with_past_model_bnb4.onnx` (added)

### ✅ Based on `decoder_with_past_model.onnx` *with* slimming

↳ ✅ `fp16`: `decoder_with_past_model_fp16.onnx` (added)
↳ ✅ `int8`: `decoder_with_past_model_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_with_past_model_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_with_past_model_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_with_past_model_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_with_past_model_bnb4.onnx` (added)

### ✅ Based on `decoder_model_merged.onnx` *with* slimming

↳ ✅ `fp16`: `decoder_model_merged_fp16.onnx` (added)
↳ ✅ `int8`: `decoder_model_merged_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_model_merged_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_model_merged_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_model_merged_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_model_merged_bnb4.onnx` (added)

### ✅ Based on `decoder_model_merged.onnx` *with* slimming

↳ ✅ `fp16`: `decoder_model_merged_fp16.onnx` (added)
↳ ✅ `int8`: `decoder_model_merged_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_model_merged_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_model_merged_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_model_merged_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_model_merged_bnb4.onnx` (added)

Files changed (17) hide show
  1. onnx/decoder_model_bnb4.onnx +3 -0
  2. onnx/decoder_model_int8.onnx +3 -0
  3. onnx/decoder_model_merged_bnb4.onnx +3 -0
  4. onnx/decoder_model_merged_fp16.onnx +3 -0
  5. onnx/decoder_model_merged_int8.onnx +3 -0
  6. onnx/decoder_model_merged_q4.onnx +3 -0
  7. onnx/decoder_model_merged_q4f16.onnx +3 -0
  8. onnx/decoder_model_merged_uint8.onnx +3 -0
  9. onnx/decoder_model_q4.onnx +3 -0
  10. onnx/decoder_model_q4f16.onnx +3 -0
  11. onnx/decoder_model_uint8.onnx +3 -0
  12. onnx/decoder_with_past_model_bnb4.onnx +3 -0
  13. onnx/decoder_with_past_model_fp16.onnx +3 -0
  14. onnx/decoder_with_past_model_int8.onnx +3 -0
  15. onnx/decoder_with_past_model_q4.onnx +3 -0
  16. onnx/decoder_with_past_model_q4f16.onnx +3 -0
  17. onnx/decoder_with_past_model_uint8.onnx +3 -0
onnx/decoder_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac90d78c33d3e7865e84d4e6798e6bb84ace80b5f218e16248a0e28362f9a2ae
3
+ size 386682366
onnx/decoder_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4feb53797cf1f30f8519707757437c35e75fdc1400f7eb68ed7338dde123ea7
3
+ size 362313550
onnx/decoder_model_merged_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80f851072ddd3a55193e2b5491ad82945da1df2c207777fdb078f20f2331e7df
3
+ size 388340643
onnx/decoder_model_merged_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9eed0f1d291dd396b6abae7da50f428ee82bc7b37dbaad8dea9f9891abfbd6bc
3
+ size 720071587
onnx/decoder_model_merged_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff1cf12a2f96864ce1b6afda2f66f412c76920915c86c32b81412cb7bb076a40
3
+ size 364051990
onnx/decoder_model_merged_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dad9ad4008a7bed24bbc5665d0d80ece6ed0542da09894475b495a2c5a0a59a
3
+ size 407344686
onnx/decoder_model_merged_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:122b212d53943e7a5fb9ee60b43266beb6f2f8cff4bddf3e2ac71307cd6a61d9
3
+ size 282969484
onnx/decoder_model_merged_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23c1e524deb7ad1f58800613fe29b384f3aa3288827bdaeb308eca98bafe5f05
3
+ size 364052022
onnx/decoder_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca2db358c137dc6844534582b4287358d03fa896dbaeac95c443babc450e75e2
3
+ size 405687138
onnx/decoder_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ded9f8fc1f368937548d41467b841725c180a2886cca1ad7e48eff8b9af4bafb
3
+ size 281304144
onnx/decoder_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84fee0e20ba459a16de63ea8e56b781d1c6e732a6540e920eb6c1f5a7a65e3fa
3
+ size 362313582
onnx/decoder_with_past_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba08856eb0605746eb81c76288e9963fe181f8c3f41ea24cc3d92e2b944be197
3
+ size 386699926
onnx/decoder_with_past_model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9564883c2228afeaffadf2e8e2591b046a965d21b20ac22775e1ad054fdde310
3
+ size 718442416
onnx/decoder_with_past_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11d4d96329d4d01e593d8a62cf686b62995ff177cb9cab23b9d7769ba595cb32
3
+ size 362330815
onnx/decoder_with_past_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:327ef136e7f273b9755cef810a28554d15581d4ed074a141cfdf7fc2270bc13a
3
+ size 405704698
onnx/decoder_with_past_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c5036d78e9bb219cae781d8dafb3e74a58402c9928537e17536aa284b399bc6
3
+ size 281329409
onnx/decoder_with_past_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8aa04f79033ed92b966c9c5529ab2a8ea72cc62ac6f819158bd8089ceaaafa90
3
+ size 362330847