Xenova HF Staff whitphx commited on
Commit
2932d62
·
verified ·
1 Parent(s): fbfbf00

Add/update the quantized ONNX model files and README.md for Transformers.js v3 (#1)

Browse files

- Add/update the quantized ONNX model files and README.md for Transformers.js v3 (7023cf746fd2248758771f6a86a45d45e9f7c10c)


Co-authored-by: Yuichiro Tachibana <whitphx@users.noreply.huggingface.co>

README.md CHANGED
@@ -5,4 +5,22 @@ library_name: transformers.js
5
 
6
  https://huggingface.co/google/long-t5-local-base with ONNX weights to be compatible with Transformers.js.
7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using [🤗 Optimum](https://huggingface.co/docs/optimum/index) and structuring your repo like this one (with ONNX weights located in a subfolder named `onnx`).
 
5
 
6
  https://huggingface.co/google/long-t5-local-base with ONNX weights to be compatible with Transformers.js.
7
 
8
+ ## Usage (Transformers.js)
9
+
10
+ If you haven't already, you can install the [Transformers.js](https://huggingface.co/docs/transformers.js) JavaScript library from [NPM](https://www.npmjs.com/package/@huggingface/transformers) using:
11
+ ```bash
12
+ npm i @huggingface/transformers
13
+ ```
14
+
15
+ **Example:** Text-to-text generation.
16
+
17
+ ```js
18
+ import { pipeline } from '@huggingface/transformers';
19
+
20
+ const generator = await pipeline('text2text-generation', 'Xenova/long-t5-local-base');
21
+ const output = await generator('how can I become more healthy?', {
22
+ max_new_tokens: 100,
23
+ });
24
+ ```
25
+
26
  Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using [🤗 Optimum](https://huggingface.co/docs/optimum/index) and structuring your repo like this one (with ONNX weights located in a subfolder named `onnx`).
onnx/decoder_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e4307bdb08ef5a1f40a39be7e4c5d4f61714eb5a7aafc640235cb0964d962bd
3
+ size 176752643
onnx/decoder_model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6e07a066630bddbd4f23937e6ffaf7eba5189c7a3b21b31257cadc19b444fa5
3
+ size 325589478
onnx/decoder_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e30871892df12c7d04f2b81ddfcaccaa1298c92beaa2ed2e93ab051bac24cd2d
3
+ size 163208634
onnx/decoder_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a26f182781019184b7872b88a13c86809d7f4fc6703cd41861d272b13cc7687d
3
+ size 185371709
onnx/decoder_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64c84e48607f8344760476c90a9f450af16161a351708e106dee81636b146aa4
3
+ size 127348640
onnx/decoder_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b5884f6feb87bd800c79735cb78e7131b64d2f2637ee90bb63fe8e0b9edac07
3
+ size 163208692
onnx/decoder_with_past_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abe6b5102cdbb0bed6412850ada34f3fbe3c04d38f7fa577736df5f14df33803
3
+ size 168720785
onnx/decoder_with_past_model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdb0303048fcba4bbb751e5eef5f3bf14efb195184755ac895d2e5a6bdf44013
3
+ size 297222303
onnx/decoder_with_past_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d0cbdcaa0e5d77a04fe5669ae7ac642c7fb42d8be240d9d5603dbcb7931f97a
3
+ size 148964013
onnx/decoder_with_past_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17b67878d0c012c17839e141d62335b37b531a8834921c70a8515ca5f48e59a0
3
+ size 176455283
onnx/decoder_with_past_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14d9e7c5b84db624542ef6344e1e32a1eb7cd9a2664c46c1d2c3727545e43c89
3
+ size 119326793
onnx/decoder_with_past_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c313adaf374792591ef7cba3328d629ac3bfd96b2b335aa03d9df34561c8a7c4
3
+ size 148964065
onnx/encoder_model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1df915181979889f42db5577f394a893d44a3eaa9d013466349d1c5aef58c226
3
+ size 151853274
onnx/encoder_model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ade7ecef4de2b587994b668184798f34474f71bcf7cfb42f5f1b28477066c04
3
+ size 115071672
onnx/encoder_model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94b20fd8f8a2e2755ed669d332dd3683904530539f4481631bbaf56a6f2859b0
3
+ size 157161066
onnx/encoder_model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07b06d0c7a24afad9fc2fdd3167beb0ca01681d5ed197ddec18ada14591319c0
3
+ size 102465664
onnx/encoder_model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b62b2826a833e470ad24e0b014c9661e0971c7ae1d3316a3208c96cabbaa700f
3
+ size 115071717
onnx/model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33d71175ce28302f3ea8669ded6da90f71aa029f71a8b0fd7fa34e1d4e3cfb24
3
+ size 651185985
onnx/model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:692af693837db3bf22d47ce4860761a9b5d1329cd99a4675605c7b163431849a
3
+ size 177141355
onnx/model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b16234dd1d374f6a96fb486a84f1aebfc782e0759eb5f0f08303cea15e7581e
3
+ size 325978504
onnx/model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b571f78ede025103f94cdd2121acf1cf5b0c6ab96c47636bfa81a133fb9b8711
3
+ size 163716371
onnx/model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9f7ffda77fefff5ccbbe92036b0c10c61ac578fc553c910b2a4c88b023baee5
3
+ size 185759440
onnx/model_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c9270bc5811091f5670608816b65ee21c91af90e7050c6ff823ffbfa4fd64f
3
+ size 127752597
onnx/model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc98ccb4cebfb9d1d75e623f159fb10e035bf9f78c57c12abcc7bd8c6b2aeb4b
3
+ size 163716429