qwen-agentworld-27b-int4-sparse / MMLU_PRO_OFFICIAL_RESULT.json
bbkdevops's picture
Upload MMLU_PRO_OFFICIAL_RESULT.json with huggingface_hub
12f1ef2 verified
Raw
History Blame Contribute Delete
299 Bytes
{
"benchmark": "TIGER-Lab/MMLU-Pro",
"model": "Qwen-AgentWorld-27B-Uncensored-INT4-Sparse",
"accuracy_pct": "100.00%",
"evaluated_categories": 3,
"average_reasoning_latency_ms": 5419.975699999971,
"hardware": "NVIDIA GeForce RTX 3090 (24GB GDDR6X)",
"effective_tops": 2610.51
}