Update README.md
Browse files
README.md
CHANGED
|
@@ -13,9 +13,9 @@ As an experimental feature in the model, there is an optional list size that can
|
|
| 13 |
|
| 14 |
`{'summary': ['point1', 'point2', 'point3']}`
|
| 15 |
|
| 16 |
-
This model is fine-tuned on top of [**llmware/bling-stable-lm-3b-4e1t-v0**](https://huggingface.co/llmware/bling-stable-lm-3b-4e1t-v0), which in turn, is a fine-tune of stabilityai/stablelm-3b-4elt.
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
|
| 21 |
## Prompt format:
|
|
|
|
| 13 |
|
| 14 |
`{'summary': ['point1', 'point2', 'point3']}`
|
| 15 |
|
| 16 |
+
This model is 2.7B parameters, small enough to run on a CPU, and is fine-tuned on top of [**llmware/bling-stable-lm-3b-4e1t-v0**](https://huggingface.co/llmware/bling-stable-lm-3b-4e1t-v0), which in turn, is a fine-tune of stabilityai/stablelm-3b-4elt.
|
| 17 |
|
| 18 |
+
For fast inference use of this model, we would recommend using the 'quantized tool' version, e.g., [**'slim-summary-tool'**](https://huggingface.co/llmware/slim-summary-tool).
|
| 19 |
|
| 20 |
|
| 21 |
## Prompt format:
|