Model save

README.md

@@ -0,0 +1,58 @@
+---
+base_model: Qwen/Qwen2.5-7B-Instruct
+library_name: transformers
+model_name: rdp_gemini_pro
+tags:
+- generated_from_trainer
+- trl
+- sft
+licence: license
+---
+
+# Model Card for rdp_gemini_pro
+
+This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="henryli525/rdp_gemini_pro", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/5250henry-university-of-cambridge/QWen2.5-7B/runs/a7v850ky) 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.15.0
+- Transformers: 4.49.0
+- Pytorch: 2.6.0
+- Datasets: 3.0.1
+- Tokenizers: 0.21.0
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "repetition_penalty": 1.05,
+  "temperature": 0.7,
+  "top_k": 20,
+  "top_p": 0.8,
+  "transformers_version": "4.49.0"
+}

model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:12748183eccf4760f12cad51c796521db19fcc321d0233797b6eb3999010af10
+oid sha256:d5d301a34ffa01c1f1775493ec498b16c5ec27c8a8cd84cbd61a4e21833642fb
 size 4877660776

model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8c80a9e91ec55473255ce3dc4f612cd1f7efdecf63838391ab1cecd3dd61c2a8
+oid sha256:b883b26d1f12c3154eba5d7282a47e3bddee2f4eb26c83bd1620f2e0ee6f7e26
 size 4932751008

model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f15896df0acccca93722f26ca6c0bfeec9a1f04db869eb17549e0b5f446e7759
+oid sha256:b67545b130d0e3ab8b6f0f6cab198183b7daee3ce2386d89b38293209c716647
 size 4330865200

model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1aa7dd2cd9bc71f702724e3ed3bcc7c7cb40eb79fe68125592b58cdab4d9492c
+oid sha256:47cfabd84b84223ed2c933e592df25de7a6f5e9f185db7254e251ecdd916a439
 size 1089994880