Haixx commited on
Commit
f4c4fff
·
verified ·
1 Parent(s): 6179fa0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +119 -0
README.md ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: Qwen/Qwen3-8B
4
+ model_type: qwen3
5
+ pipeline_tag: text-generation
6
+ license: mit
7
+ language:
8
+ - en
9
+ tags:
10
+ - peer-review
11
+ - scientific-papers
12
+ - GRPO
13
+ - reinforcement-learning
14
+ - paper-review
15
+ datasets:
16
+ - UKPLab/ProReviewer-Dataset
17
+ citation: |
18
+ @article{fang2026passive,
19
+ title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
20
+ author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
21
+ journal={arXiv preprint arXiv:2606.13349},
22
+ year={2026}
23
+ }
24
+ ---
25
+
26
+ # ProReviewer-8B
27
+
28
+ An RL-trained scientific peer review model based on [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B). ProReviewer-8B is fine-tuned using Group Relative Policy Optimization (GRPO) to produce high-quality, evidence-based peer reviews of scientific papers.
29
+
30
+ ## Model Description
31
+
32
+ ProReviewer-8B is the backbone model for the **ProReviewer** agent, an R1-style reasoning agent that reviews scientific papers through structured investigation rather than passive generation. The model was trained with a multi-stage curriculum:
33
+
34
+ 1. **Stage 1 (Format)**: Learning proper review structure and tool use
35
+ 2. **Stage 2 (Evidence + Memory)**: Learning evidence-based judgment with structured memory (claims, questions, assessments, review outline)
36
+
37
+ The model is designed to work with the ProReviewer agent framework, which provides:
38
+ - **Structured Memory**: Tracks claims, questions, assessments, and review outline as the agent reads through a paper
39
+ - **Paper Navigation**: Tools for reading sections and searching paper content
40
+ - **Evidence-Based Judgment**: Grounds review points in specific paper evidence
41
+
42
+ ### Training Details
43
+
44
+ | Parameter | Value |
45
+ |-----------|-------|
46
+ | Base model | Qwen/Qwen3-8B |
47
+ | Training method | GRPO with step-level advantages |
48
+ | Training data | ICLR 2025 papers ([UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)) |
49
+ | Architecture | Qwen3ForCausalLM |
50
+ | Parameters | 8B |
51
+ | Context length | 40,960 tokens |
52
+ | Precision | bfloat16 |
53
+
54
+ ### Reward Components
55
+
56
+ The model was trained with a multi-dimensional reward function:
57
+
58
+ | Component | Description |
59
+ |-----------|-------------|
60
+ | Format Compliance | Proper review structure (summary, strengths, weaknesses, questions, score) |
61
+ | Score Difference | Alignment between predicted and human average scores |
62
+ | Rubric Evaluation | Technical depth, grounding specificity, actionability, verifiability |
63
+ | Duplicate Detection | Penalizes repeated weaknesses |
64
+
65
+ ## Usage
66
+
67
+ ### With the ProReviewer Agent
68
+
69
+ The recommended way to use this model is through the ProReviewer agent framework:
70
+
71
+ ```python
72
+ from reviewer.core.proreviewer import ProReviewer
73
+ from reviewer.core.review_env import ReviewEnv
74
+ from reviewer.evaluation import run_inference
75
+
76
+ paper = {
77
+ "paper_id": "example",
78
+ "paper_content": "# Paper Title\n\nAbstract: ...",
79
+ "human_avg_score": 5.0,
80
+ }
81
+
82
+ result = await run_inference(paper, model="UKPLab/ProReviewer-8B")
83
+ ```
84
+
85
+ ### With vLLM
86
+
87
+ ```bash
88
+ vllm serve UKPLab/ProReviewer-8B --max-model-len 16384 --dtype bfloat16
89
+ ```
90
+
91
+ ### With Transformers
92
+
93
+ ```python
94
+ from transformers import AutoModelForCausalLM, AutoTokenizer
95
+
96
+ model = AutoModelForCausalLM.from_pretrained("UKPLab/ProReviewer-8B", torch_dtype="bfloat16")
97
+ tokenizer = AutoTokenizer.from_pretrained("UKPLab/ProReviewer-8B")
98
+ ```
99
+
100
+ ## Associated Resources
101
+
102
+ - **Paper**: [From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent](https://arxiv.org/abs/2606.13349)
103
+ - **Code**: [UKPLab/arxiv2026-ProReviewer](https://github.com/UKPLab/arxiv2026-ProReviewer)
104
+ - **Dataset**: [UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)
105
+
106
+ ## Citation
107
+
108
+ ```bibtex
109
+ @article{fang2026passive,
110
+ title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
111
+ author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
112
+ journal={arXiv preprint arXiv:2606.13349},
113
+ year={2026}
114
+ }
115
+ ```
116
+
117
+ ## License
118
+
119
+ This model is released under the [MIT License](https://opensource.org/licenses/MIT).