nm-testing
/

TinyLlama-1.1B-Chat-v1.0-2of4-Sparse-Dense-Compressor

compressed-tensors

Model card Files Files and versions

TinyLlama-1.1B-Chat-v1.0-2of4-Sparse-Dense-Compressor / recipe.yaml

dsikka's picture

Upload folder using huggingface_hub

fdf9596 verified over 1 year ago

history blame contribute delete

184 Bytes

	sparsity_stage:
	sparsity_modifiers:
	SparseGPTModifier: {sparsity: 0.5, mask_structure: '2:4'}
	run_type: !!python/object/apply:llmcompressor.recipe.stage.StageRunType [oneshot]