Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Fu01978
/
TinyLM
like
0
Text Generation
Transformers
PyTorch
roneneldan/TinyStories
Skylion007/openwebtext
English
TinyLM
tiny
language-model
causal-lm
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
TinyLM
/
config.json
Fu01978
Upload folder using huggingface_hub
ff5d275
verified
5 days ago
raw
Copy download link
history
blame
contribute
delete
179 Bytes
{
"model_type"
:
"TinyLM"
,
"vocab_size"
:
50257
,
"embed_rank"
:
32
,
"d_model"
:
64
,
"n_heads"
:
4
,
"ffn_dim"
:
192
,
"n_layers"
:
4
,
"max_seq_len"
:
256
,
"dropout"
:
0.0
}