Update Fp16_Learned / flan_t5_xxl_TE-only/Readme.txt
Browse files
Fp16_Learned / flan_t5_xxl_TE-only/Readme.txt
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
Source code moved to https://github.com/marduk191/
|
| 2 |
|
| 3 |
This improves quality when converting text encoders from fp32 to fp16 so you get great quality without much zise gain over traditional fp16.
|
| 4 |
Fp8 learned rounding is also great quality vs traditional fp8, but most models benefit from increased precision.
|
|
|
|
| 1 |
+
Source code moved to https://github.com/marduk191/fp16_learned_rounding
|
| 2 |
|
| 3 |
This improves quality when converting text encoders from fp32 to fp16 so you get great quality without much zise gain over traditional fp16.
|
| 4 |
Fp8 learned rounding is also great quality vs traditional fp8, but most models benefit from increased precision.
|