Instructions to use ArtusDev/Vortex5_Poetic-Rune-12B-EXL3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ArtusDev/Vortex5_Poetic-Rune-12B-EXL3 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ArtusDev/Vortex5_Poetic-Rune-12B-EXL3", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -43,3 +43,6 @@ Download quant by targeting the specific quant revision (branch):
|
|
| 43 |
huggingface-cli download ArtusDev/Vortex5_Poetic-Rune-12B-EXL3 --revision "5.0bpw_H6" --local-dir ./
|
| 44 |
```
|
| 45 |
</details>
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
huggingface-cli download ArtusDev/Vortex5_Poetic-Rune-12B-EXL3 --revision "5.0bpw_H6" --local-dir ./
|
| 44 |
```
|
| 45 |
</details>
|
| 46 |
+
|
| 47 |
+
### Acknowledgements
|
| 48 |
+
**Made possible with the help of cloud compute from [***lium.io***](https://lium.io/)**
|