We performed a 20% REAP on the base model this is preparation for CPT and SFT/DPO. Further releases will be under IRIS 18B.

Benchmark Score Notes
ARC-Easy 79.59% acc_norm
ARC-Challenge 50.60% acc_norm
HellaSwag 70.50% acc_norm
Winogrande 67.17% acc
GSM8K 79.00% exact_match (flexible-extract)
MMLU 65.82% acc (average across all subjects)
Downloads last month
814
Safetensors
Model size
18B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jerrimu/ERNIE-21B-REAP

Finetuned
(2)
this model
Finetunes
1 model
Quantizations
1 model