16dvnk
/

AaI_mini.plus_beta_250824_Base

Text Generation

Model card Files Files and versions

AaI_mini.plus_beta_250824_Base / config.json

16dvnk's picture

Upload config.json

80b55fb verified 13 days ago

history blame contribute delete

140 Bytes

	{
	"VOCAB_SIZE": 10000,
	"SEQ_LENGTH": 256,
	"MODEL_DIM": 432,
	"NUM_HEADS": 6,
	"NUM_LAYERS": 6,
	"DROPOUT": 0.1
	}