Commit History

Add symbio_model.py for Colab notebook imports
d968181
verified

LisaMegaWatts commited on

Add 2MB val text sample for Gemma/HF tokenizer notebooks
588ff7f
verified

LisaMegaWatts commited on

Add 20MB raw text sample for Gemma/HF tokenizer notebooks
d9422a5
verified

LisaMegaWatts commited on

Upload README.md with huggingface_hub
4bf22dd
verified

LisaMegaWatts commited on

Distillation test winner (scratch, PPL=43.9, 5M params)
49d0c4c
verified

LisaMegaWatts commited on

Upload merges.txt with huggingface_hub
b7fe905
verified

LisaMegaWatts commited on

Upload vocab.json with huggingface_hub
912c171
verified

LisaMegaWatts commited on

Upload best checkpoint (val_loss=3.5599)
69e2d95
verified

LisaMegaWatts commited on

Upload SymbioGPT-10M teacher (val_ppl=35.3, 13400 steps, A100)
06b4943
verified

LisaMegaWatts commited on

Add curated training tokens (266M tokens, Chinchilla-optimal)
ab3f5b8
verified

LisaMegaWatts commited on

Add validation tokens (72M tokens)
ff30a4a
verified

LisaMegaWatts commited on