XiangPan
/

L12_K64_1B_OpenWebText2_16384_steps3052

Model card Files Files and versions

L12_K64_1B_OpenWebText2_16384_steps3052 / config.json

XiangPan's picture

Upload TopK

7fbb7d8 verified 9 months ago

history blame contribute delete

60 Bytes

	{
	"hidden_size": 2048,
	"latent_size": 16384,
	"k": 64
	}