Arko007
/

Zenyx-42M

Text Generation

custom-architecture

Model card Files Files and versions

Zenyx-42M / config.json

Arko007's picture

Upload Nano-GPT 42M (99,000 iterations, val_loss=3.0801)

9bb1019 verified 7 months ago

history blame contribute delete

130 Bytes

	{
	"vocab_size": 32000,
	"n_layers": 8,
	"n_heads": 8,
	"n_embd": 512,
	"block_size": 512,
	"dropout": 0.1,
	"bias": true
	}