i3-lab
/

i3-500m

Text Generation

Model card Files Files and versions

i3-500m / config.json

FlameF0X's picture

Upload folder using huggingface_hub

96bd7ca verified about 2 months ago

history blame contribute delete

180 Bytes

	{
	"architectures": [
	"i3HybridModel"
	],
	"model_type": "rwkv-hybrid",
	"d_model": 1180,
	"n_layers": 20,
	"rwkv_layers": 16,
	"attn_layers": 4,
	"vocab_size": 32000
	}