Instructions to use bartowski/CatPPT-exl2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use bartowski/CatPPT-exl2 with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Add 4.0 link
Browse files
README.md
CHANGED
|
@@ -37,6 +37,8 @@ Default arguments used except when the bits per weight is above 6.0, at that poi
|
|
| 37 |
|
| 38 |
Original model: https://huggingface.co/rishiraj/CatPPT
|
| 39 |
|
|
|
|
|
|
|
| 40 |
<a href="https://huggingface.co/bartowski/CatPPT-exl2/tree/5_0">5.0 bits per weight</a>
|
| 41 |
|
| 42 |
<a href="https://huggingface.co/bartowski/CatPPT-exl2/tree/6_5">6.5 bits per weight</a>
|
|
|
|
| 37 |
|
| 38 |
Original model: https://huggingface.co/rishiraj/CatPPT
|
| 39 |
|
| 40 |
+
<a href="https://huggingface.co/bartowski/CatPPT-exl2/tree/4_0">4.0 bits per weight</a>
|
| 41 |
+
|
| 42 |
<a href="https://huggingface.co/bartowski/CatPPT-exl2/tree/5_0">5.0 bits per weight</a>
|
| 43 |
|
| 44 |
<a href="https://huggingface.co/bartowski/CatPPT-exl2/tree/6_5">6.5 bits per weight</a>
|