Update README.md

README.md

@@ -9,29 +9,43 @@ tags:
 model-index:
 - name: DCFT-Stratos-Verified-114k-7B-4gpus
   results: []
+datasets:
+- open-thoughts/open-thoughts-114k
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+<p align="center">
+    <img src="https://huggingface.co/datasets/open-thoughts/open-thoughts-114k/resolve/main/open_thoughts.png" width="50%">
+</p>
 
-# DCFT-Stratos-Verified-114k-7B-4gpus
+# OpenThinker-7B
 
-This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on the mlfoundations-dev/stratos_verified_mix dataset.
+This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on the 
+[OpenThoughts-114k dataset](https://huggingface.co/datasets/open-thoughts/OpenThoughts-114k) dataset.
 
-## Model description
+The dataset is derived by distilling DeepSeek-R1 using the [data pipeline available on github](https://github.com/open-thoughts/open-thoughts). 
+More info about the dataset can be found on the dataset card at [OpenThoughts-114k dataset](https://huggingface.co/datasets/open-thoughts/open-thoughts-114k).
 
-More information needed
+This model improves upon the [Bespoke-Stratos-7B model](https://huggingface.co/bespokelabs/Bespoke-Stratos-7B), which used 17k examples ([Bespoke-Stratos-17k dataset](https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k)).
 
-## Intended uses & limitations
 
-More information needed
+|  | AIME24 | MATH500 | GPQA-D | LCB Easy | LCB Med | LCB Hard | Open Weights | Open Data | Open Code | 
+|--|--------|---------|--------|----------|---------|----------|--------------|-----------| --------- |
+|OpenThinker-7B|26.7|86|40.4|74.2|31.1|3.3|✔|[✔](https://huggingface.co/datasets/open-thoughts/OpenThoughts-114k)|[✔](https://github.com/open-thoughts/open-thoughts) |
+|Bespoke-Stratos-7B|20.0|82.0|37.8|71.4|25.2|1.6|✔|[✔](https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k)|[✔](https://github.com/bespokelabsai/curator/tree/main/examples/bespoke-stratos-data-generation)|
+|DeepSeek-R1-Distill-Qwen-7B|43.3|89.4|44.9|81.3|42.2|2.4|✔|❌|❌|
+|gpt-4o-0513|9.3|74.6|49.9|-|-|-|❌|❌|❌|
+|o1-mini|63.6|90.0|60.0|-|-|-|❌|❌|❌|
+
 
-## Training and evaluation data
+## Intended uses & limitations
+
+Apache 2.0 License
 
-More information needed
 
 ## Training procedure
 
+We used four 8xH100 nodes to train the model for 20 hours.
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -49,13 +63,21 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_ratio: 0.1
 - num_epochs: 3.0
 
-### Training results
-
-
-
 ### Framework versions
 
 - Transformers 4.46.1
 - Pytorch 2.3.0
 - Datasets 3.1.0
 - Tokenizers 0.20.3
+
+More info can be found in our repository: [https://github.com/open-thoughts/open-thoughts](https://github.com/open-thoughts/open-thoughts).
+
+# Links
+- 📊 [Open Thoughts Launch Blog Post](https://www.open-thoughts.ai/blog/launch)
+- 📊 [Open Thoughts GitHub Repository](https://github.com/open-thoughts/open-thoughts)
+- 🧠 [OpenThoughts-114k dataset](https://huggingface.co/datasets/open-thoughts/OpenThoughts-114k)
+- 🤖 [OpenThinker-7B model](https://huggingface.co/open-thoughts/OpenThinker-7B) - this model.
+- 📊 [Bespoke-Stratos Blog Post](https://www.bespokelabs.ai/blog/bespoke-stratos-the-unreasonable-effectiveness-of-reasoning-distillation)
+- 🧠 [Bespoke-Stratos-17k dataset](https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k)
+- 🤖 [Bespoke-Stratos-32B model](https://huggingface.co/bespokelabs/Bespoke-Stratos-32B)
+- 🤖 [Bespoke-Stratos-7B model](https://huggingface.co/bespokelabs/Bespoke-Stratos-7B)