KFAC-OBD-Dream-Base

BashCache 's Collections

updated about 13 hours ago

Dream-org/Dream-v0-Base-7B structurally pruned with KFAC-OBD (SNR-weighted) at 20/30/40% sparsity, with LoRA adapters.

BashCache/temp-dream-base-20-snr-weighted

7B • Updated 16 days ago • 29

Note 20% structured-pruned Dream-v0-Base-7B (KFAC-OBD, SNR-weighted)
BashCache/temp-dream-base-20-snr-weighted-adapters-v1

Text Generation • Updated 15 days ago • 24

Note LoRA adapter recovering the 20% pruned model; load on top of BashCache/temp-dream-base-20-snr-weighted
BashCache/temp-dream-base-30-snr-weighted

6B • Updated 16 days ago • 28

Note 30% structured-pruned Dream-v0-Base-7B (KFAC-OBD, SNR-weighted)
BashCache/temp-dream-base-30-snr-weighted-adapters-v1

Text Generation • Updated 15 days ago • 18

Note LoRA adapter recovering the 30% pruned model; load on top of BashCache/temp-dream-base-30-snr-weighted
BashCache/temp-dream-base-40-snr-weighted

5B • Updated 16 days ago • 27

Note 40% structured-pruned Dream-v0-Base-7B (KFAC-OBD, SNR-weighted)
BashCache/temp-dream-base-40-snr-weighted-adapters-v1

Text Generation • Updated 15 days ago • 19

Note LoRA adapter recovering the 40% pruned model; load on top of BashCache/temp-dream-base-40-snr-weighted