| license: apache-2.0 | |
| language: | |
| - en | |
| - es | |
| - fr | |
| tags: | |
| - merge | |
| - onnx | |
|  | |
| palmer-003 is appvoid's lastest effort into creating the best small, general language model possible. | |
| ``` | |
| Query: Your instruction | |
| Answer: | |
| ``` | |
| **Evaluation** | |
| ``` | |
| Model MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average Params | |
| tinyllama-3t | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B | | |
| zyte-1b | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 | 1.1B | | |
| palmer-003 | 0.2523 | 0.3439 | 0.3740 | 0.6208 | 0.7524 | 0.6590 | 0.5004 | 1.1B | | |
| qwen-1.8b | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B | | |
| ``` | |
| You can support me [through kofi](https://ko-fi.com/appvoid). |