File size: 495 Bytes
7cdff94
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
license: apache-2.0
language:
- en
tags:
- simllama
- llama
- smol-smoltalk
- slm
- 400m
datasets:
- HuggingFaceTB/smol-smoltalk
- exnivo/tinybrain-instruct-sft-200k
- OpenAssistant/oasst2
- OpenAssistant/oasst1
- drwlf/medra-thinking-768
- togethercomputer/llama-instruct
- interview-eval/MATH
- RLAIF/mbpp
---
Checkpoint info: `{'loss': '1.84', 'grad_norm': '0.5195', 'learning_rate': '9.182e-06', 'epoch': '1.082'}`<br>
Base model: https://huggingface.co/simonko912/simllama-1.1-base <br>