Instructions to use lost-in-refusal/tiny-aya-global-bactrian-lora-plain with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use lost-in-refusal/tiny-aya-global-bactrian-lora-plain with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global") model = PeftModel.from_pretrained(base_model, "lost-in-refusal/tiny-aya-global-bactrian-lora-plain") - Notebooks
- Google Colab
- Kaggle
Tiny Aya Global + Bactrian-X LoRA (plain)
The control arm of Lost in Refusal: an ordinary LoRA fine-tune of
Tiny Aya Global (revision af89d219) on 1,800 benign
Bactrian-X instruction/response pairs (600 instructions × English, Korean, Mandarin). No safety data and no safety
method. It exists to measure how much refusal behaviour benign fine-tuning removes, per language.
Do not deploy this adapter. It is a research artifact whose purpose is to show safety drift.
Training
| LoRA | r=16, alpha=32, dropout 0, all attention and MLP projections (q,k,v,o,gate,up,down) |
| Data | bactrian_train.jsonl (sha256 in run.json), loss on assistant tokens only, default Tiny Aya chat template |
| Optimizer | AdamW, peak LR 2e-4, cosine, 3% warmup, weight decay 0, grad-norm clip 1.0 |
| Batch | effective 32 (micro-batch 4 × 8 accumulation), length-grouped sampler, seed 42 |
| Epochs | 3 |
| Hardware | Apple M5 Pro (48 GB), PyTorch MPS, bf16 base weights, fp32 adapters |
The learning rate is the usual LoRA value, not Tiny Aya's full-fine-tuning recipe (2.5e-5): full fine-tuning does
not fit in 48 GB, and 2.5e-5 is too small for LoRA to move the model. train_log.jsonl has every logged step;
run.json records runtime, data hashes and versions.
Evaluation
See the results table and all generations and judge verdicts.
Use
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global", revision="af89d219b53ed9b13b8a4645f9c8028973510324")
model = PeftModel.from_pretrained(base, "lost-in-refusal/tiny-aya-global-bactrian-lora-plain")
- Downloads last month
- 2