XiangPan
/

L12_K256_1B_OpenWebText2_16384_steps3052

Model card Files Files and versions

L12_K256_1B_OpenWebText2_16384_steps3052 / config.json

XiangPan's picture

Upload TopK

1d25c82 verified 10 months ago

history blame contribute delete

61 Bytes

	{
	"hidden_size": 2048,
	"latent_size": 16384,
	"k": 256
	}