ProReviewer-8B / README.md
Haixx's picture
Update README.md
4e8b619 verified
|
Raw
History Blame Contribute Delete
3.18 kB
---
library_name: transformers
base_model: Qwen/Qwen3-8B
model_type: qwen3
pipeline_tag: text-generation
license: mit
language:
- en
tags:
- peer-review
- scientific-papers
- GRPO
- reinforcement-learning
- paper-review
datasets:
- UKPLab/ProReviewer-Dataset
citation: |
@article{fang2026passive,
title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
journal={arXiv preprint arXiv:2606.13349},
year={2026}
}
---
# ProReviewer-8B
An RL-trained scientific peer review model based on [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B). ProReviewer-8B is fine-tuned using Group Relative Policy Optimization (GRPO) to produce high-quality, evidence-based peer reviews of scientific papers.
## Model Description
ProReviewer-8B is the backbone model for the **ProReviewer** agent, an R1-style reasoning agent that reviews scientific papers through structured investigation rather than passive generation. The model was trained with a multi-stage curriculum:
### Training Details
| Parameter | Value |
|-----------|-------|
| Base model | Qwen/Qwen3-8B |
| Training method | SFT+ GRPO with step-level advantages |
| Training data | ICLR 2025 papers ([UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)) |
| Architecture | Qwen3ForCausalLM |
| Parameters | 8B |
| Precision | bfloat16 |
## Usage
### With vLLM
```bash
vllm serve UKPLab/ProReviewer-8B --max-model-len 32768 --dtype bfloat16
```
### With the ProReviewer Agent
The recommended way to use this model is through the ProReviewer agent framework in the [ProReviewer](https://github.com/UKPLab/arxiv2026-ProReviewer):
```python
from reviewer.evaluation import run_inference
paper = {
"paper_id": "example",
"paper_content": "# Paper Title\n\nAbstract: ...",
"human_avg_score": 5.0,
}
# Option 1: Use a config name from config.toml (model served via vLLM)
result = await run_inference(paper, model="proreviewer-8B")
# Option 2: Use a local path (loads model directly via vLLM)
result = await run_inference(paper, model="/path/to/ProReviewer-8B")
```
### With Transformers
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("UKPLab/ProReviewer-8B", torch_dtype="bfloat16")
tokenizer = AutoTokenizer.from_pretrained("UKPLab/ProReviewer-8B")
```
## Associated Resources
- **Paper**: [From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent](https://arxiv.org/abs/2606.13349)
- **Code**: [UKPLab/arxiv2026-ProReviewer](https://github.com/UKPLab/arxiv2026-ProReviewer)
- **Dataset**: [UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)
## Citation
```bibtex
@article{fang2026passive,
title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
journal={arXiv preprint arXiv:2606.13349},
year={2026}
}
```
## License
This model is released under the [MIT License](https://opensource.org/licenses/MIT).