| license: apache-2.0 | |
| language: | |
| - en | |
| tags: | |
| - simllama | |
| - llama | |
| - smol-smoltalk | |
| - slm | |
| - 400m | |
| datasets: | |
| - HuggingFaceTB/smol-smoltalk | |
| - exnivo/tinybrain-instruct-sft-200k | |
| - OpenAssistant/oasst2 | |
| - OpenAssistant/oasst1 | |
| - drwlf/medra-thinking-768 | |
| - togethercomputer/llama-instruct | |
| - interview-eval/MATH | |
| - RLAIF/mbpp | |
| Checkpoint info: `{'loss': '1.84', 'grad_norm': '0.5195', 'learning_rate': '9.182e-06', 'epoch': '1.082'}`<br> | |
| Base model: https://huggingface.co/simonko912/simllama-1.1-base <br> |