Generated README.md
Browse files
README.md
CHANGED
|
@@ -26,10 +26,12 @@ Dolly is trained on ~15k instruction/response fine tuning records databricks-dol
|
|
| 26 |
| [dolly-v2-3b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-f16.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | F16 | GGML | V3 |
|
| 27 |
| [dolly-v2-3b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGML | V3 |
|
| 28 |
| [dolly-v2-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGJT | V3 |
|
|
|
|
| 29 |
| [dolly-v2-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGJT | V3 |
|
| 30 |
| [dolly-v2-7b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-f16.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | F16 | GGML | V3 |
|
| 31 |
| [dolly-v2-7b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGML | V3 |
|
| 32 |
| [dolly-v2-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGJT | V3 |
|
|
|
|
| 33 |
| [dolly-v2-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGJT | V3 |
|
| 34 |
|
| 35 |
## Usage
|
|
|
|
| 26 |
| [dolly-v2-3b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-f16.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | F16 | GGML | V3 |
|
| 27 |
| [dolly-v2-3b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGML | V3 |
|
| 28 |
| [dolly-v2-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGJT | V3 |
|
| 29 |
+
| [dolly-v2-3b-q5_1.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGML | V3 |
|
| 30 |
| [dolly-v2-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGJT | V3 |
|
| 31 |
| [dolly-v2-7b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-f16.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | F16 | GGML | V3 |
|
| 32 |
| [dolly-v2-7b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGML | V3 |
|
| 33 |
| [dolly-v2-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGJT | V3 |
|
| 34 |
+
| [dolly-v2-7b-q5_1.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGML | V3 |
|
| 35 |
| [dolly-v2-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGJT | V3 |
|
| 36 |
|
| 37 |
## Usage
|