KFAC-OBD-Llada-Base

BashCache 's Collections

updated about 13 hours ago

GSAI-ML/LLaDA-8B-Base structurally pruned with KFAC-OBD (SNR-weighted) at 20/30/40% sparsity, with LoRA adapters.

BashCache/temp-llada-base-20-snr-weighted

7B • Updated 23 days ago • 57

Note 20% structured-pruned LLaDA-8B-Base (KFAC-OBD, SNR-weighted)
BashCache/temp-llada-base-20-snr-weighted-adapters-v3

Text Generation • Updated 22 days ago • 24

Note LoRA adapter recovering the 20% pruned model; load on top of BashCache/temp-llada-base-20-snr-weighted
BashCache/temp-llada-base-30-snr-weighted

6B • Updated 23 days ago • 16

Note 30% structured-pruned LLaDA-8B-Base (KFAC-OBD, SNR-weighted)
BashCache/temp-llada-base-30-snr-weighted-adapters-v3

Text Generation • Updated 22 days ago • 26

Note LoRA adapter recovering the 30% pruned model; load on top of BashCache/temp-llada-base-30-snr-weighted
BashCache/temp-llada-base-40-snr-weighted

6B • Updated 23 days ago • 16

Note 40% structured-pruned LLaDA-8B-Base (KFAC-OBD, SNR-weighted)
BashCache/temp-llada-base-40-snr-weighted-adapters-v3

Text Generation • Updated 22 days ago • 19

Note LoRA adapter recovering the 40% pruned model; load on top of BashCache/temp-llada-base-40-snr-weighted