maxie-12321
/

phi-mini-moe-pruned-specialized-v1

Mixture of Experts

mixture-of-attention

Model card Files Files and versions

phi-mini-moe-pruned-specialized-v1 / pruning_stats.json

maxie-12321's picture

Upload pruning_stats.json with huggingface_hub

b8ab5f9 verified 27 days ago

history blame contribute delete

142 Bytes

	{
	"before": 32,
	"after": 24,
	"pruned_heads": [
	7,
	6,
	4,
	5,
	1,
	0,
	2,
	3
	],
	"reduction_percent": 25.0
	}