Update README.md
Browse files
README.md
CHANGED
|
@@ -85,7 +85,6 @@ outputs = model.generate(
|
|
| 85 |
|
| 86 |
We build the Doge-Instruct by first SFT on [SmolTalk](https://huggingface.co/datasets/HuggingFaceTB/smoltalk) and then DPO on [UltraFeedback Binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized).
|
| 87 |
|
| 88 |
-
> TODO: The larger model is under training and will be uploaded soon.
|
| 89 |
|
| 90 |
**SFT**:
|
| 91 |
| Model | Training Data | Epochs | Content Length | LR | Batch Size | Precision |
|
|
|
|
| 85 |
|
| 86 |
We build the Doge-Instruct by first SFT on [SmolTalk](https://huggingface.co/datasets/HuggingFaceTB/smoltalk) and then DPO on [UltraFeedback Binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized).
|
| 87 |
|
|
|
|
| 88 |
|
| 89 |
**SFT**:
|
| 90 |
| Model | Training Data | Epochs | Content Length | LR | Batch Size | Precision |
|