Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,15 @@ I'm excited to announce the release of a new model called Mistral-7B-code-16k-ql
|
|
| 9 |
|
| 10 |
This model was trained on 3x RTX 3090 in my homelab, using around 65kWh for approximately 23 cents, which is equivalent to around $15 for electricity.
|
| 11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
## Dataset:
|
| 13 |
nickrosh/Evol-Instruct-Code-80k-v1
|
| 14 |
https://huggingface.co/datasets/nickrosh/Evol-Instruct-Code-80k-v1
|
|
|
|
| 9 |
|
| 10 |
This model was trained on 3x RTX 3090 in my homelab, using around 65kWh for approximately 23 cents, which is equivalent to around $15 for electricity.
|
| 11 |
|
| 12 |
+
## Quantized:
|
| 13 |
+
|
| 14 |
+
1. https://huggingface.co/TheBloke/Mistral-7B-Code-16K-qlora-GPTQ
|
| 15 |
+
|
| 16 |
+
2. https://huggingface.co/TheBloke/Mistral-7B-Code-16K-qlora-AWQ
|
| 17 |
+
|
| 18 |
+
3. https://huggingface.co/TheBloke/Mistral-7B-Code-16K-qlora-GGUF
|
| 19 |
+
|
| 20 |
+
|
| 21 |
## Dataset:
|
| 22 |
nickrosh/Evol-Instruct-Code-80k-v1
|
| 23 |
https://huggingface.co/datasets/nickrosh/Evol-Instruct-Code-80k-v1
|