allenai / SERA-8B

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of SERA-8B via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.00bpw	3.23	0.3343	12.3507
3.00bpw	4.04	0.0716	10.4401
4.00bpw	4.83	0.0173	10.2288
5.00bpw	5.64	0.0057	10.1801
6.00bpw	6.46	0.0014	10.1897
bf16	15.26	0.0000	10.1737

CLI Download

huggingface-cli download UnstableLlama/SERA-8B-exl3 --revision "4.00bpw" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/SERA-8B-exl3

Base model

Quantized

(7)

this model