Hugging Face's logo

Compactbot
/
ram-18m-training-scripts

Text Generation
English
tiny
slm
small-language-model
from-scratch
gqa
swiglu
rope
training-script
Model card Files
xet
 Community
2
ram-18m-training-scripts / train_ram_18m.py

Commit History

Add ram-18m training script (18,290,304 params, LLaMA-style GQA+SwiGLU) (#1)
143fec7

Compactbot commited on