zkolter
/

RL-Homework

Text Generation

Model card Files Files and versions

RL-Homework / params.json

zkolter's picture

Add params.json

b095deb verified 20 days ago

history blame contribute delete

117 Bytes

	{
	"dim": 1024,
	"ffn_dim": 4096,
	"max_seq_len": 1024,
	"n_heads": 16,
	"n_layers": 8,
	"num_tokens": 50432
	}