tinyllama-50pct-sparse / recipe.yaml
saroshq's picture
Add TinyLlama with 50% sparsity
8bc863e verified
default_stage:
default_modifiers:
SparseGPTModifier:
sparsity: 0.5
mask_structure: 0:0
sequential_update: false
sequential_targets: [LlamaDecoderLayer]
targets: Linear
ignore: []
block_size: 128
dampening_frac: 0.01
preserve_sparsity_mask: false
offload_hessians: false