Quazim0t0
/

Casa-14b-sce

Eval Results (legacy)

Model card Files Files and versions

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	40.63
IFEval (0-Shot)	67.18
BBH (3-Shot)	55.33
MATH Lvl 5 (4-Shot)	47.66
GPQA (0-shot)	11.19
MuSR (0-shot)	13.44
MMLU-PRO (5-shot)	48.98

Downloads last month: -

Safetensors

Model size

15B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using Quazim0t0/Casa-14b-sce 1

Evaluation results

strict accuracy on IFEval (0-Shot)
Open LLM Leaderboard

67.180
normalized accuracy on BBH (3-Shot)
Open LLM Leaderboard

55.330
exact match on MATH Lvl 5 (4-Shot)
Open LLM Leaderboard

47.660
acc_norm on GPQA (0-shot)
Open LLM Leaderboard

11.190
acc_norm on MuSR (0-shot)
Open LLM Leaderboard

13.440
accuracy on MMLU-PRO (5-shot)
test set Open LLM Leaderboard

48.980