Update README.md
Browse files
README.md
CHANGED
|
@@ -5,9 +5,9 @@ language:
|
|
| 5 |
license: mit
|
| 6 |
tags:
|
| 7 |
- HelpingAI
|
| 8 |
-
- GGUF
|
| 9 |
- lite
|
| 10 |
- code
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
#### Description
|
|
@@ -48,5 +48,4 @@ The differentiator between GGJT and GGUF lies in the deliberate adoption of a ke
|
|
| 48 |
| q5_k_m | 5-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |
|
| 49 |
| q5_k_s | 5-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |
|
| 50 |
| q6_k | 6-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |
|
| 51 |
-
| q8_0 | 8-bit integers | Significant model size reduction | Minimal impact on accuracy |
|
| 52 |
-
|
|
|
|
| 5 |
license: mit
|
| 6 |
tags:
|
| 7 |
- HelpingAI
|
|
|
|
| 8 |
- lite
|
| 9 |
- code
|
| 10 |
+
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
| 13 |
#### Description
|
|
|
|
| 48 |
| q5_k_m | 5-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |
|
| 49 |
| q5_k_s | 5-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |
|
| 50 |
| q6_k | 6-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |
|
| 51 |
+
| q8_0 | 8-bit integers | Significant model size reduction | Minimal impact on accuracy |
|
|
|