ProCreations commited on
Commit
ecfdbd8
·
verified ·
1 Parent(s): 0e22fb1

Make benchmark comparison grug

Browse files

Rewrite the shared 27B/35B benchmark section in the model cards' established Grug voice without changing any benchmark values.

Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -107,12 +107,12 @@ saving and stability. MATH-500 show the trade win on hard unseen ground.
107
  - known wart fixed in v2.1: think sometimes too thin on hard problems;
108
  over-verification in long agent sessions.
109
 
110
- ## 27b vs 35b on shared benchmarks
111
 
112
- HumanEval and sanitized MBPP are the benchmarks published for both current
113
- parent checkpoints. Scores are pass@1 percent; bold marks the better result.
114
 
115
- | benchmark | [grug-27b](https://huggingface.co/ProCreations/grug-27b) v2.1 | [grug-35b](https://huggingface.co/ProCreations/grug-35b) rebuilt main |
116
  |---|---:|---:|
117
  | HumanEval (164) | **87.2** | 80.5 |
118
  | MBPP sanitized (100) | 85.0 | **88.0** |
 
107
  - known wart fixed in v2.1: think sometimes too thin on hard problems;
108
  over-verification in long agent sessions.
109
 
110
+ ## 27b and 35b hunt same prey
111
 
112
+ both grug hunt HumanEval and sanitized MBPP. number show pass@1 percent.
113
+ bold grug win that hunt.
114
 
115
+ | hunt | [grug-27b](https://huggingface.co/ProCreations/grug-27b) v2.1 | [grug-35b](https://huggingface.co/ProCreations/grug-35b) rebuilt |
116
  |---|---:|---:|
117
  | HumanEval (164) | **87.2** | 80.5 |
118
  | MBPP sanitized (100) | 85.0 | **88.0** |