Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
|
| 12 |
|
| 13 |
-
The inference speed of lyraBELLE has achieved **3x+** acceleration upon the original version.
|
| 14 |
|
| 15 |
Among its main features are:
|
| 16 |
|
|
@@ -20,7 +20,7 @@ Among its main features are:
|
|
| 20 |
Note that:
|
| 21 |
**Some interface/code were set for future uses(see demo below).**
|
| 22 |
|
| 23 |
-
- **int8 mode**: not supported yet, please always set it
|
| 24 |
- **data type**: only `fp16` available.
|
| 25 |
|
| 26 |
|
|
@@ -34,7 +34,7 @@ Note that:
|
|
| 34 |
- percision:fp16
|
| 35 |
- batch size:64
|
| 36 |
- language: chinese, keep same in a batch.
|
| 37 |
-
- do_sample: True, model generate slightly different answser to same question.
|
| 38 |
|
| 39 |
|
| 40 |
|version|speed|
|
|
|
|
| 10 |
|
| 11 |
lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
|
| 12 |
|
| 13 |
+
The inference speed of lyraBELLE has achieved **3.3x+** acceleration upon the original version.
|
| 14 |
|
| 15 |
Among its main features are:
|
| 16 |
|
|
|
|
| 20 |
Note that:
|
| 21 |
**Some interface/code were set for future uses(see demo below).**
|
| 22 |
|
| 23 |
+
- **int8 mode**: not supported yet, please always set it at 0
|
| 24 |
- **data type**: only `fp16` available.
|
| 25 |
|
| 26 |
|
|
|
|
| 34 |
- percision:fp16
|
| 35 |
- batch size:64
|
| 36 |
- language: chinese, keep same in a batch.
|
| 37 |
+
- do_sample: True, model generate slightly different answser to the same question.
|
| 38 |
|
| 39 |
|
| 40 |
|version|speed|
|