truettwo
/

task6

Question Answering

Model card Files Files and versions

Llama-3.2-1B + LoRA — SQuAD 2.0 QA

Результаты

Метод	F1	Exact Match
Zero-shot	8.28%	4.0%
Few-shot (5)	0.0%	0.0%
LoRA fine-tuned	61.63%	43.0%

Конфигурация LoRA

r=16, alpha=32, dropout=0.05
max_steps=500, lr=2e-4, warmup=50
4-bit NF4 QLoRA (unsloth)

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for truettwo/task6

Base model

meta-llama/Llama-3.2-1B

Adapter

(682)

this model

Dataset used to train truettwo/task6