ai4bharat/BPCC
Viewer • Updated • 235M • 1.38k • 35
How to use aymanmakroo/kav with PEFT:
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained("facebook/nllb-200-distilled-1.3B")
model = PeftModel.from_pretrained(base_model, "aymanmakroo/kav")A LoRA adapter fine-tuning facebook/nllb-200-distilled-1.3B for English to Kashmiri
(Perso-Arabic script, kas_Arab) translation.
Full training methodology, data details, decoding configuration, and the post-processing pipeline this adapter is meant to be used with are documented in the companion GitHub repository:aym-n/kav
facebook/nllb-200-distilled-1.3Br=32, alpha=64, dropout=0.05q_proj, k_proj, v_proj, out_proj, fc1, fc2 (attention
and feed-forward layers)eng_Latn — Target language: kas_ArabBase model
facebook/nllb-200-distilled-1.3B