>> allenai / SERA-14B

[QUANTS BY :: UnstableLlama]

// Information

exl3 quantizations of SERA-14B via exllamav3.

Repo generated automatically with ezexl3.

// Repo Data

REVISION	GiB	KL DIV	PPL
2.00bpw	5.08	0.3344	11.2076
3.00bpw	6.62	0.0663	9.3265
4.00bpw	8.15	0.0174	9.1251
5.00bpw	9.69	0.0047	9.1056
6.00bpw	11.23	0.0015	9.0675
bf16	27.51	0.0000	9.0610

SVG Catbench

3.00 bpw

4.00 bpw

5.00 bpw

6.00 bpw

BF16

// CLI Download

huggingface-cli download UnstableLlama/SERA-14B-exl3 --revision "6.00bpw" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/SERA-14B-exl3

Base model

Quantized

(4)

this model