Hugging Face's logo

tinyllms
/
qwen2.5-7b-instruct-sft-loo-domain-knowledge

Safetensors
qwen2
leave-one-out
loo-domain-knowledge
max_seq_length=16384
lr=2e-5
batch_size=1
grad_accum=16
epochs=1
qlora
quantize=4bit_nf4
lora_rank=64
lora_alpha=128
lora_dropout=0.05
completion_only_loss
eval_size=0.1
cosine_schedule
warmup=0.05
bf16
ddp_workers=2
ray_job=raysubmit_A55M5NnZckrXmfWN
Model card Files
xet
 Community
qwen2.5-7b-instruct-sft-loo-domain-knowledge / tokenizer.json

Commit History

Upload folder using huggingface_hub
94f9646
verified

psr-ai commited on