Hugging Face's logo

ArtusDev
/
Delta-Vector_Austral-24B-Winton-EXL2

Transformers
English
roleplay
finetune
axolotl
adventure
creative-writing
Mistral
24B
exl2
Model card Files
xet
 Community

EXL2 Quants of Delta-Vector/Austral-24B-Winton

EXL2 quants of Delta-Vector/Austral-24B-Winton using exllamav2 for quantization.

Quants

Quant(Revision) Bits per Weight Head Bits
4.0_H6 4.0 6
4.5_H6 4.5 6

Downloading quants with huggingface-cli

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2 --revision "5.0bpw_H6" --local-dir ./
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.1-24B-Instruct-2503
Finetuned
LatitudeGames/Harbinger-24B
Finetuned
Delta-Vector/Austral-24B-Base
Finetuned
Delta-Vector/Austral-SFT-KTO
Finetuned
Delta-Vector/Austral-24B-Winton
Quantized
(11)
this model