SaminSkyfall commited on
Commit
9dc57aa
·
verified ·
1 Parent(s): 88769ff

Model save

Browse files
Files changed (2) hide show
  1. README.md +6 -6
  2. generation_config.json +6 -8
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
- base_model: Qwen/Qwen3-0.6B
3
  library_name: transformers
4
- model_name: sft
5
  tags:
6
  - generated_from_trainer
7
  - trl
@@ -9,9 +9,9 @@ tags:
9
  licence: license
10
  ---
11
 
12
- # Model Card for sft
13
 
14
- This model is a fine-tuned version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
@@ -20,14 +20,14 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
20
  from transformers import pipeline
21
 
22
  question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
- generator = pipeline("text-generation", model="SaminSkyfall/sft", device="cuda")
24
  output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
  print(output["generated_text"])
26
  ```
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/samin-skyfall-ai/huggingface/runs/5obf7lq0)
31
 
32
 
33
  This model was trained with SFT.
 
1
  ---
2
+ base_model: microsoft/Phi-3-mini-4k-instruct
3
  library_name: transformers
4
+ model_name: sft_phi3
5
  tags:
6
  - generated_from_trainer
7
  - trl
 
9
  licence: license
10
  ---
11
 
12
+ # Model Card for sft_phi3
13
 
14
+ This model is a fine-tuned version of [microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
20
  from transformers import pipeline
21
 
22
  question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
+ generator = pipeline("text-generation", model="SaminSkyfall/sft_phi3", device="cuda")
24
  output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
  print(output["generated_text"])
26
  ```
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/samin-skyfall-ai/huggingface/runs/4pwjt53v)
31
 
32
 
33
  This model was trained with SFT.
generation_config.json CHANGED
@@ -1,13 +1,11 @@
1
  {
2
- "bos_token_id": 151643,
3
- "do_sample": true,
4
  "eos_token_id": [
5
- 151645,
6
- 151643
 
7
  ],
8
- "pad_token_id": 151643,
9
- "temperature": 0.6,
10
- "top_k": 20,
11
- "top_p": 0.95,
12
  "transformers_version": "4.51.3"
13
  }
 
1
  {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
  "eos_token_id": [
5
+ 32000,
6
+ 32001,
7
+ 32007
8
  ],
9
+ "pad_token_id": 32000,
 
 
 
10
  "transformers_version": "4.51.3"
11
  }