Text Classification
Transformers
Safetensors
English
qwen2
reward-model
code-generation
rlhf
text-embeddings-inference
Instructions to use Rishubi/CodeRM-NT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Rishubi/CodeRM-NT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Rishubi/CodeRM-NT")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Rishubi/CodeRM-NT") model = AutoModelForSequenceClassification.from_pretrained("Rishubi/CodeRM-NT", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ library_name: transformers
|
|
| 12 |
---
|
| 13 |
|
| 14 |
# CodeRM-NT
|
| 15 |
-
[Paper](https://
|
| 16 |
[Github](https://github.com/THUDM/CodeRM-NT)
|
| 17 |
|
| 18 |
Providing accurate reward signals for code generated by LLMs is a significant challenge in applying reinforcement learning (RL) to code generation. Existing methods rely on unit tests, which are expensive to curate and unreliable when automatically synthesized.
|
|
@@ -65,4 +65,25 @@ Training with CodeRM-NT consistently outperforms synthetic unit tests and other
|
|
| 65 |
|
| 66 |
## Citation
|
| 67 |
|
| 68 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
# CodeRM-NT
|
| 15 |
+
[Paper](https://aclanthology.org/2026.findings-acl.2150/) |
|
| 16 |
[Github](https://github.com/THUDM/CodeRM-NT)
|
| 17 |
|
| 18 |
Providing accurate reward signals for code generated by LLMs is a significant challenge in applying reinforcement learning (RL) to code generation. Existing methods rely on unit tests, which are expensive to curate and unreliable when automatically synthesized.
|
|
|
|
| 65 |
|
| 66 |
## Citation
|
| 67 |
|
| 68 |
+
If you find our work helpful, please kindly cite our paper:
|
| 69 |
+
|
| 70 |
+
```
|
| 71 |
+
@inproceedings{xia-etal-2026-coderm,
|
| 72 |
+
title = "{C}ode{RM}-{NT}: Reward Model for Code {RL} without Unit Tests",
|
| 73 |
+
author = "Xia, Xiao and
|
| 74 |
+
Zhang, Dan and
|
| 75 |
+
Sun, Tianrui",
|
| 76 |
+
editor = "Liakata, Maria and
|
| 77 |
+
Moreira, Viviane P. and
|
| 78 |
+
Zhang, Jiajun and
|
| 79 |
+
Jurgens, David",
|
| 80 |
+
booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {ACL} 2026",
|
| 81 |
+
month = jul,
|
| 82 |
+
year = "2026",
|
| 83 |
+
address = "San Diego, California, United States",
|
| 84 |
+
publisher = "Association for Computational Linguistics",
|
| 85 |
+
url = "https://aclanthology.org/2026.findings-acl.2150/",
|
| 86 |
+
pages = "43316--43333",
|
| 87 |
+
ISBN = "979-8-89176-395-1"
|
| 88 |
+
}
|
| 89 |
+
```
|