End of training

README.md

@@ -1,17 +1,19 @@
 ---
 base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
+datasets: knoveleng/open-rs
 library_name: transformers
 model_name: MMR-DAPO
 tags:
 - generated_from_trainer
-- trl
+- open-r1
 - dapo
+- trl
 licence: license
 ---
 
 # Model Card for MMR-DAPO
 
-This model is a fine-tuned version of [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B).
+This model is a fine-tuned version of [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) on the [knoveleng/open-rs](https://huggingface.co/datasets/knoveleng/open-rs) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).
 
 ## Quick start

config.json

@@ -53,7 +53,7 @@
   "sliding_window": null,
   "tie_word_embeddings": false,
   "transformers_version": "4.57.1",
-  "use_cache": false,
+  "use_cache": true,
   "use_mrope": false,
   "use_sliding_window": false,
   "vocab_size": 151936