thejaminator commited on
Commit
2d1a01d
·
verified ·
1 Parent(s): 5aefc76

Add README with base model metadata

Browse files
Files changed (1) hide show
  1. README.md +23 -15
README.md CHANGED
@@ -1,22 +1,30 @@
1
  ---
2
  base_model: unsloth/Qwen3-8B
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen3
8
- - trl
9
- license: apache-2.0
10
- language:
11
- - en
12
  ---
13
 
14
- # Uploaded model
15
 
16
- - **Developed by:** thejaminator
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/Qwen3-8B
19
 
20
- This qwen3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: unsloth/Qwen3-8B
3
+ library_name: peft
 
 
 
 
 
 
 
 
4
  ---
5
 
6
+ # LoRA Adapter for SFT
7
 
8
+ This is a LoRA (Low-Rank Adaptation) adapter trained using supervised fine-tuning (SFT).
 
 
9
 
10
+ ## Base Model
11
+ - **Base Model**: `unsloth/Qwen3-8B`
12
+ - **Adapter Type**: LoRA
13
+ - **Task**: Supervised Fine-Tuning
14
 
15
+ ## Usage
16
+
17
+ ```python
18
+ from transformers import AutoModelForCausalLM, AutoTokenizer
19
+ from peft import PeftModel
20
+
21
+ # Load base model and tokenizer
22
+ base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3-8B")
23
+ tokenizer = AutoTokenizer.from_pretrained("unsloth/Qwen3-8B")
24
+
25
+ # Load LoRA adapter
26
+ model = PeftModel.from_pretrained(base_model, "thejaminator/6k_risky_10k_aligned_facts")
27
+ ```
28
+
29
+ ## Training Details
30
+ This adapter was trained using supervised fine-tuning on conversation data to improve the model's ability to follow instructions and generate helpful responses.