Ba2han commited on
Commit
670ef67
·
verified ·
1 Parent(s): bbd58c0

Training in progress, step 8856

Browse files
Files changed (3) hide show
  1. README.md +59 -0
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Ba2han/model-phase3
3
+ library_name: transformers
4
+ model_name: model-phase3
5
+ tags:
6
+ - generated_from_trainer
7
+ - sft
8
+ - trl
9
+ - unsloth
10
+ licence: license
11
+ ---
12
+
13
+ # Model Card for model-phase3
14
+
15
+ This model is a fine-tuned version of [Ba2han/model-phase3](https://huggingface.co/Ba2han/model-phase3).
16
+ It has been trained using [TRL](https://github.com/huggingface/trl).
17
+
18
+ ## Quick start
19
+
20
+ ```python
21
+ from transformers import pipeline
22
+
23
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
24
+ generator = pipeline("text-generation", model="Ba2han/model-phase3", device="cuda")
25
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
26
+ print(output["generated_text"])
27
+ ```
28
+
29
+ ## Training procedure
30
+
31
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/batuhan409/huggingface/runs/l7nxxmzk)
32
+
33
+
34
+ This model was trained with SFT.
35
+
36
+ ### Framework versions
37
+
38
+ - TRL: 0.24.0
39
+ - Transformers: 4.57.1
40
+ - Pytorch: 2.9.0
41
+ - Datasets: 4.3.0
42
+ - Tokenizers: 0.22.1
43
+
44
+ ## Citations
45
+
46
+
47
+
48
+ Cite TRL as:
49
+
50
+ ```bibtex
51
+ @misc{vonwerra2022trl,
52
+ title = {{TRL: Transformer Reinforcement Learning}},
53
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
54
+ year = 2020,
55
+ journal = {GitHub repository},
56
+ publisher = {GitHub},
57
+ howpublished = {\url{https://github.com/huggingface/trl}}
58
+ }
59
+ ```
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1198074ef44f7177a0639235ffb4a778d5961d48b453c36ab8d5b3bfd5b7f9a
3
  size 1000557344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3eef16d6fa2724db351f523d57dc6d30dd9467a85d0ddaaed93aee287bef39c0
3
  size 1000557344
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a499b9bb471364e5825828d6af1b283be4f20e4fd8b98f02f170cadf22e490d7
3
  size 6289
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1fc6f7721ad8493cec520b7795feea8df0afc8337806d4bce4203f4067084bb
3
  size 6289