tyb343/rounded-off-tiny-aya-bank-sft
Text Generation • 3B • Updated • 47
Tiny Aya Global fine-tuned as an English+Hindi bank assistant, repaired with SafeTune, tested at 4-bit and 3-bit. Research only. Lexsi hackathon.
Note M1: plain bank fine-tune (SafeTune PlainSFT, LoRA r16). The drifted model.
Note R_wise50: M1 repaired with WiSE-FT alpha 0.5. Best benign repair.
Note CR_wise50: contaminated fine-tune repaired with WiSE-FT alpha 0.5. Research only.
Note CR_resta25: contaminated fine-tune repaired with RESTA alpha 0.25. Research only.
Note M0: the base model (CC-BY-NC-4.0).