XiangPan
/

L12_K128_1B_OpenWebText2_16384_steps3052

Model card Files Files and versions

L12_K128_1B_OpenWebText2_16384_steps3052 / config.json

XiangPan's picture

Upload TopK

86d57ce verified 9 months ago

history blame contribute delete

61 Bytes

	{
	"hidden_size": 2048,
	"latent_size": 16384,
	"k": 128
	}