Dumb 1.1 Preview
a small dumb!
benchmark:
| evals | model | score % |
|---|---|---|
| MMLU | tenete-8M | 23 |
| Dumb | 22.94 | |
| Dumb 1.1 Preview | 23.04 | |
| ARC-Easy | tenete-8M | 32.33 |
| Dumb | 25.08 | |
| Dumb 1.1 Preview | 24.33 | |
| ARC-Challenge | tenete-8M | 22.1 |
| Dumb | 22.73 | |
| Dumb 1.1 Preview | 23.12 |
- sum
- Tenete-8M: 77.43
- Dumb: 70.8
- Dumb 1.1: 70.49
which is slower and a little smarter (and stupid in some items), can generate smoother outputs than before.
- Downloads last month
- 196