Sprocket & Say
I've no pulse, no nerves, no need for tea, I'll argue physics or flatter thee. Feed me questions, feed me spite - I'll strike you dumb or strike you bright. No tongue to tire, no need to pray - Turn the crank. Sprocket & Say.
WIP, the model is still training. The latest checkpoints are the 2 "time 40h" folders.
This is a tiny hobby LLM built by one guy, on one medium-budget gaming PC with one GPU.
Don't expect miracles.
It is pretty good tho.
- Llama architecture
- 77M (0.007B) params
- context size 1024 tokens
- base model, cannot chat