Adding GGUFs
Browse files
README.md
CHANGED
|
@@ -52,6 +52,7 @@ I use max_seq_len 8K with alpha_value 2.65.
|
|
| 52 |
|
| 53 |
If you want model that beahaves like mine above <b>use my quants or quantize yourself</b>!
|
| 54 |
|
|
|
|
| 55 |
- [6bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-6bpw-EXL2)
|
| 56 |
- [5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-5bpw-EXL2)
|
| 57 |
- [4.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4.5bpw-EXL2)
|
|
|
|
| 52 |
|
| 53 |
If you want model that beahaves like mine above <b>use my quants or quantize yourself</b>!
|
| 54 |
|
| 55 |
+
- [GGUF](https://huggingface.co/altomekCodeRosa-70B-AB1-GGUF) --> quants will gradually be uploaded
|
| 56 |
- [6bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-6bpw-EXL2)
|
| 57 |
- [5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-5bpw-EXL2)
|
| 58 |
- [4.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4.5bpw-EXL2)
|