Benchmark	Measure		160M MiniPile	160M Pile Deduplicated
ARC-Challenge	acc	↑	0.2125 ± 0.0120	0.1997 ± 0.0117
MMLU	acc	↑	0.2699 ± 0.0037	0.2299 ± 0.0035
HellaSwag	acc	↑	0.2560 ± 0.0044	0.2903 ± 0.0045
WinoGrande	acc	↑	0.4720 ± 0.0140	0.4964 ± 0.0141
Lambada (OpenAI)	acc	↑	0.0000 ± 0.0000	0.3689 ± 0.0067
Lambada (OpenAI)	perplexity	↓	3033175.2693 ± 288926.5827	31.2589 ± 1.1594
Lambada (Std)	acc	↑	0.0000 ± 0.0000	0.2335 ± 0.0059
Lambada (Std)	perplexity	↓	27067951.3461 ± 2710040.1910	172.7619 ± 7.7265
BLiMP	acc	↑	0.5194 ± 0.0018	0.7294 ± 0.0015

Safetensors

Model size

0.1B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Marcus2112/pythia-160m-minipile

Base model

Finetuned

(52)

this model

Dataset used to train Marcus2112/pythia-160m-minipile