vanishingMonk commited on
Commit
9637c72
·
verified ·
1 Parent(s): 46955f0

Add LoRA adapter weights and config

Browse files

LoRA adapter for meta-llama/Llama-3.1-8B-Instruct.

This model is fine-tuned for generating contrastive explanations for OWL reasoning tasks.

Method:
- LoRA fine-tuning (r=8, alpha=16)
- Trained using domain-specific OWL reasoning datasets

Usage:

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = "meta-llama/Llama-3.1-8B-Instruct"

tokenizer = AutoTokenizer.from_pretrained(base_model)
base = AutoModelForCausalLM.from_pretrained(base_model)

model = PeftModel.from_pretrained(base, "your-username/your-repo-name")

Notes:
- This repository contains only LoRA adapter weights
- Base model must be loaded separately

Files changed (2) hide show
  1. adapter_config.json +1 -0
  2. adapter_model.safetensors +3 -0
adapter_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"r": 8, "lora_alpha": 16, "target_modules": ["q_proj", "v_proj", "o_proj", "gate_proj", "down_proj", "up_proj"], "peft_type": "LORA", "base_model_name_or_path": "meta-llama/Meta-Llama-3.1-8B-Instruct"}
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4db42dac6d70ee851de4ea8c11e99c328bc4dd801701e65e8024639d1e0106ba
3
+ size 39372544