AI-Roadmap
/

SmolLM2-135M-rm-60k

Model card Files Files and versions

AI-Roadmap commited on May 14, 2025

Commit

2c19894

·

verified ·

1 Parent(s): 0bf611b

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -57,6 +57,4 @@ This model is trained by OpenRLHF.
    model.eval().to("cuda")
    ```
-8. The model is trained and saved using FP32. The accuracy on test dataset is:
-   - With FP32, the accuracy is:
-   - With BF16, the accuracy is:

    model.eval().to("cuda")
    ```
+8. Test accuracy: 0.764425, chosen reward: -0.032832, reject reward: -1.620852