Add link to paper page

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -1,24 +1,24 @@
1
  ---
2
- license: apache-2.0
3
  base_model: Qwen/Qwen3-8B
4
- pipeline_tag: text-generation
5
- library_name: transformers
6
  language:
7
- - en
 
 
 
8
  tags:
9
- - spyrl
10
- - rlsvr
11
- - self-play
12
- - reinforcement-learning
13
- - mathematical-reasoning
14
- - reasoning
15
  ---
16
 
17
  # SpyRL-Qwen3-8B-Math
18
 
19
  Qwen3-8B trained with SpyRL on mathematical reasoning. In the performing stage each agent designs *and* solves a problem grounded in a math-heavy web document; the spy sees the same document with a contiguous 40% span masked out.
20
 
21
- Trained with **SpyRL**, the reference implementation of **RLSVR** (Reinforcement Learning with Self-Verifiable Rewards) from the COLM 2026 paper *From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement*.
22
 
23
  RLSVR extends RLVR to open-ended tasks the way self-supervised learning extends supervised learning: instead of approximating a missing reward with a judge or reward model, it *transforms* the task into a proxy environment whose own rules generate the reward. SpyRL instantiates that as a multi-agent self-play game inspired by *Who Is the Spy?* — civilians receive the full input, one spy receives a masked copy, all agents perform the same target task, and then they vote on who the spy is. Because the environment assigns the spy identity up front, the vote is exactly checkable, and avoiding suspicion requires producing genuinely better output.
24
 
@@ -89,4 +89,4 @@ bash spyrl/train_math_reasoning.sh
89
  booktitle = {Conference on Language Modeling (COLM)},
90
  year = {2026}
91
  }
92
- ```
 
1
  ---
 
2
  base_model: Qwen/Qwen3-8B
 
 
3
  language:
4
+ - en
5
+ library_name: transformers
6
+ license: apache-2.0
7
+ pipeline_tag: text-generation
8
  tags:
9
+ - spyrl
10
+ - rlsvr
11
+ - self-play
12
+ - reinforcement-learning
13
+ - mathematical-reasoning
14
+ - reasoning
15
  ---
16
 
17
  # SpyRL-Qwen3-8B-Math
18
 
19
  Qwen3-8B trained with SpyRL on mathematical reasoning. In the performing stage each agent designs *and* solves a problem grounded in a math-heavy web document; the spy sees the same document with a contiguous 40% span masked out.
20
 
21
+ Trained with **SpyRL**, the reference implementation of **RLSVR** (Reinforcement Learning with Self-Verifiable Rewards) from the COLM 2026 paper [*From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement*](https://huggingface.co/papers/2607.23802).
22
 
23
  RLSVR extends RLVR to open-ended tasks the way self-supervised learning extends supervised learning: instead of approximating a missing reward with a judge or reward model, it *transforms* the task into a proxy environment whose own rules generate the reward. SpyRL instantiates that as a multi-agent self-play game inspired by *Who Is the Spy?* — civilians receive the full input, one spy receives a masked copy, all agents perform the same target task, and then they vote on who the spy is. Because the environment assigns the spy identity up front, the vote is exactly checkable, and avoiding suspicion requires producing genuinely better output.
24
 
 
89
  booktitle = {Conference on Language Modeling (COLM)},
90
  year = {2026}
91
  }
92
+ ```