the regular model is Q4_K_M quantized and the "L" model is Q4_K_S quantized for those of you on android :)
MFANN 3v version 0.7
fine-tuned on the MFANN dataset as it stands on 5/5/2024 as it is an ever changing and expaning dataset.
62.98 <- Average 61.69 <- ARC 75.98 <- HellaSwag 55.4 <- MMLU 53.49 <- TruthfulQA 77.66 <- Winogrande (this models strong-suit) 53.68 <- GSM8K
this model is completely uncensored
- Downloads last month
- 29
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support