abideen
/

AlphaMonarch-laser

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

abideen commited on Feb 21, 2024

Commit

ded4679

·

verified ·

1 Parent(s): 9b4781a

Update README.md

Files changed (1) hide show

README.md +2 -5

README.md CHANGED Viewed

@@ -28,13 +28,10 @@ should probably proofread and complete it, then remove this comment. -->
 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/64e380b2e12618b261fa6ba0/62S_ExHO6NKCM3NhPDrds.jpeg)
-</details><br>
-# out
-This model is a fine-tuned version of [mlabonne/NeuralMonarch-7B](https://huggingface.co/mlabonne/NeuralMonarch-7B) on an unknown dataset.
 ## Model description

 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/64e380b2e12618b261fa6ba0/62S_ExHO6NKCM3NhPDrds.jpeg)
+AlphaMonarch-laser is a DPO fine-tuned of [mlabonne/NeuralMonarch-7B](https://huggingface.co/mlabonne/NeuralMonarch-7B/) using the [argilla/OpenHermes2.5-dpo-binarized-alpha](https://huggingface.co/datasets/argilla/OpenHermes2.5-dpo-binarized-alpha) preference dataset but achieves better performance then [mlabonne/AlphaMonarch-7B](https://huggingface.co/mlabonne/AlphaMonarch-7B/) using
+This model is a fine-tuned version of [mlabonne/NeuralMonarch-7B](https://huggingface.co/mlabonne/NeuralMonarch-7B) on
 ## Model description