Fu01978
/

TinyLM

Text Generation

Model card Files Files and versions

TinyLM / config.json

Fu01978's picture

Upload folder using huggingface_hub

ff5d275 verified 5 days ago

history blame contribute delete

179 Bytes

	{
	"model_type": "TinyLM",
	"vocab_size": 50257,
	"embed_rank": 32,
	"d_model": 64,
	"n_heads": 4,
	"ffn_dim": 192,
	"n_layers": 4,
	"max_seq_len": 256,
	"dropout": 0.0
	}