SaminSkyfall commited on
Commit
aba2b50
·
verified ·
1 Parent(s): 25d3ac3

Model save

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -1,15 +1,15 @@
1
  ---
2
  base_model: Qwen/Qwen3-0.6B
3
  library_name: transformers
4
- model_name: reward
5
  tags:
6
  - generated_from_trainer
7
  - trl
8
- - reward-trainer
9
  licence: license
10
  ---
11
 
12
- # Model Card for reward
13
 
14
  This model is a fine-tuned version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
@@ -20,17 +20,17 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
20
  from transformers import pipeline
21
 
22
  question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
- generator = pipeline("text-generation", model="SaminSkyfall/reward", device="cuda")
24
  output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
  print(output["generated_text"])
26
  ```
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/samin-skyfall-ai/huggingface/runs/jjqlknpu)
31
 
32
 
33
- This model was trained with Reward.
34
 
35
  ### Framework versions
36
 
 
1
  ---
2
  base_model: Qwen/Qwen3-0.6B
3
  library_name: transformers
4
+ model_name: sft
5
  tags:
6
  - generated_from_trainer
7
  - trl
8
+ - sft
9
  licence: license
10
  ---
11
 
12
+ # Model Card for sft
13
 
14
  This model is a fine-tuned version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
 
20
  from transformers import pipeline
21
 
22
  question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
+ generator = pipeline("text-generation", model="SaminSkyfall/sft", device="cuda")
24
  output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
  print(output["generated_text"])
26
  ```
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/samin-skyfall-ai/huggingface/runs/mp2iuoa0)
31
 
32
 
33
+ This model was trained with SFT.
34
 
35
  ### Framework versions
36