Commit History

Add zero-shot benchmark results (ARC, HellaSwag, SciQ, PIQA) and full-split val ppl (#1)
0f4e319

Compactbot commited on

BPE-8k tokenizer (HF tokenizers format)
6d8613e
verified

Compactbot commited on

weights: 24.59M params, 75 tensors, float32
d02797d
verified

Compactbot commited on

TinyStories-24m: 24.59M BPE GPT trained from scratch on TinyStories (val ppl 8.76, coherent)
c6c9cdf
verified

Compactbot commited on

initial commit
cbe0202
verified

Compactbot commited on