allenai / SERA-32B

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of SERA-32B via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.00bpw	9.28	0.0.3151	9.1782
3.00bpw	12.91	0.0864	8.1422
4.00bpw	16.54	0.0272	7.9847
5.00bpw	20.17	0.0086	7.9666
6.00bpw	23.801	0.0026	7.9361
bf16	61.02	0.0000	7.9336

CLI Download

huggingface-cli download UnstableLlama/SERA-32B-exl3 --revision "2.00bpw" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/SERA-32B-exl3

Base model

Quantized

(12)

this model