Xenova HF Staff whitphx HF Staff commited on
Commit
6a8d2b5
·
verified ·
1 Parent(s): 31ba097

Add/update the quantized ONNX model files and README.md for Transformers.js v3 (#1)

Browse files

- Add/update the quantized ONNX model files and README.md for Transformers.js v3 (0a2f2ca5ba7ebd1bd213e6fea2e4b578a1035cc8)


Co-authored-by: Yuichiro Tachibana <[email protected]>

README.md CHANGED
@@ -5,4 +5,22 @@ library_name: transformers.js
5
 
6
  https://huggingface.co/t5-base with ONNX weights to be compatible with Transformers.js.
7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using [🤗 Optimum](https://huggingface.co/docs/optimum/index) and structuring your repo like this one (with ONNX weights located in a subfolder named `onnx`).
 
5
 
6
  https://huggingface.co/t5-base with ONNX weights to be compatible with Transformers.js.
7
 
8
+ ## Usage (Transformers.js)
9
+
10
+ If you haven't already, you can install the [Transformers.js](https://huggingface.co/docs/transformers.js) JavaScript library from [NPM](https://www.npmjs.com/package/@huggingface/transformers) using:
11
+ ```bash
12
+ npm i @huggingface/transformers
13
+ ```
14
+
15
+ **Example:** Text-to-text generation.
16
+
17
+ ```js
18
+ import { pipeline } from '@huggingface/transformers';
19
+
20
+ const generator = await pipeline('text2text-generation', 'Xenova/t5-base');
21
+ const output = await generator('how can I become more healthy?', {
22
+ max_new_tokens: 100,
23
+ });
24
+ ```
25
+
26
  Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using [🤗 Optimum](https://huggingface.co/docs/optimum/index) and structuring your repo like this one (with ONNX weights located in a subfolder named `onnx`).
onnx/decoder_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dcf09db1f59d61cd61b7b323a213646dff1eee0ed19a01f7d587247d27d24b9
3
+ size 162831208
onnx/decoder_model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6dc2608b29e0347a2bf226e23d44da6c48d8ffbf06068775c0c944154beb382
3
+ size 276200771
onnx/decoder_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d4ee29479192dad6007e2265170d9bcf0fc9c4bc2dbff85754e559641ad7f82
3
+ size 237178354
onnx/decoder_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55067bf128d84a114e1ff59ce750ea7ead496788b78d532fd75a9105fce06a34
3
+ size 169908232
onnx/decoder_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1113abae9815b68cc647d31cb6e1f847b0dafd34b7c7d3e0a0dda9e991322ea
3
+ size 113427317
onnx/decoder_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:881d78b9a97e146ff74d3f4c10978fa2127dda7f80c5e576797832717662d1dc
3
+ size 237178424
onnx/decoder_with_past_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db17f6e7939da08a9ab1d2a475ac1151b71ed0ebc47ca1311ac4994c900ae10b
3
+ size 154802243
onnx/decoder_with_past_model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b92e07722b3687a7fe8b4dfd969f233bfb6329fab683f99f184414670e359da
3
+ size 247836488
onnx/decoder_with_past_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e938599ace7fa2a6663dfebde4949a96c1f4c2917f56a1752aec54512712a01e
3
+ size 222936626
onnx/decoder_with_past_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed78955d31485a3a36cf5d88b4b0b444d6d92208060fc2fb7292bc8f62f64e75
3
+ size 160994699
onnx/decoder_with_past_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3de050ad6d7c20432c7c326f04c31c87e0f5fa85fb9e9c9cbbd5fa117e830155
3
+ size 105408363
onnx/decoder_with_past_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f6960392ba2249b45ededf2c76e796898e4af4dac182936efbfdd53aea1f202
3
+ size 222936681
onnx/encoder_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebdcfd278475da2531654995fdbcc2ed181e84ddd708ba1628d0d3c5c08a8d73
3
+ size 146712592
onnx/encoder_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2458d7455a684ad03fa9cb60c2ba667ab20d4c2a4a3bd5f978cf3fc7d1da2da
3
+ size 109918758
onnx/encoder_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fddc42d18e74e2091723b8ab7c609e30b469fc002ac1234dec2d1351cd69c400
3
+ size 152020480
onnx/encoder_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e81e1a4f6ad8563d75a8c38d9c6e19efbdbb3b02b933aca44c57f6d8806583f9
3
+ size 97325051
onnx/encoder_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:821680cebb9e34e2da0afa176392cb7c398614f732b6a37f72ce832c0c02b41f
3
+ size 109918793