XiangPan
/

L12_K32_1B_OpenWebText2_16384_steps3052

Model card Files Files and versions

L12_K32_1B_OpenWebText2_16384_steps3052 / config.json

XiangPan's picture

Upload TopK

c47ddda verified 9 months ago

history blame contribute delete

60 Bytes

	{
	"hidden_size": 2048,
	"latent_size": 16384,
	"k": 32
	}