Safetensors
qwen2
nielsr HF Staff commited on
Commit
bab667b
·
verified ·
1 Parent(s): f5df8b7

Improve model card and add metadata

Browse files

Hi! I'm Niels from the community science team at Hugging Face.

I noticed this model card could be improved with additional metadata and clearer links to the research paper. This PR updates the model card to:
- Add `pipeline_tag: text-generation` and `library_name: transformers` metadata for better discoverability and integration.
- Link the model to its research paper: [RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL System](https://huggingface.co/papers/2602.02488).
- Correct the model name from "TraDo" to **RLAnything** as per the official repository.
- Include a direct link to the code on GitHub and the project blog.
- Add an overview of the key features and performance highlights.

Please let me know if you have any questions!

Files changed (1) hide show
  1. README.md +13 -16
README.md CHANGED
@@ -1,41 +1,38 @@
1
  ---
2
  license: mit
 
 
3
  ---
4
 
5
-
6
- # Introduction to TraDo
7
 
8
  [Paper](https://arxiv.org/abs/2602.02488) | [Code](https://github.com/Gen-Verse/Open-AgentRL) | [Blog](https://yinjjiew.github.io/projects/rlanything/)
9
 
10
- We introduce **RLAnything**, a reinforcement learning framework forges environment, policy and reward model in a completely dynamic system to enhance the training signals and improve the whole system.
11
-
12
- * **Integrated Feedback for Policy:** The policy is trained with integrated outcome and step-wise signals from reward model.
13
- * **Consistency Feedback for Reward Model:** The Reward model is jointly optimized by consistency feedback, further improves policy training.
14
- * **Critic Feedback for Environment:** Our theory-motivated automatic environment adaptation improves training for both the reward and policy models by leveraging critic feedback from each.
15
-
16
 
 
 
 
 
17
 
18
  <p align="center">
19
  <img src="https://github.com/yinjjiew/Data/raw/main/rlanything/rlanythingoverview.png" width="100%"/>
20
  </p>
21
 
 
 
22
 
23
  <p align="center">
24
  <img src="https://github.com/yinjjiew/Data/raw/main/rlanything/rlanythingmaintable.png" width="100%"/>
25
  </p>
26
 
 
27
 
28
-
29
-
30
- # Citation
31
-
32
- ```
33
  @article{wang2026rlanything,
34
  title={RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL System},
35
  author={Wang, Yinjie and Xie, Tianbao and Shen, Ke and Wang, Mengdi and Yang, Ling},
36
  journal={arXiv preprint arXiv:2602.02488},
37
  year={2026}
38
  }
39
- ```
40
-
41
-
 
1
  ---
2
  license: mit
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
  ---
6
 
7
+ # RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL System
 
8
 
9
  [Paper](https://arxiv.org/abs/2602.02488) | [Code](https://github.com/Gen-Verse/Open-AgentRL) | [Blog](https://yinjjiew.github.io/projects/rlanything/)
10
 
11
+ **RLAnything** is a reinforcement learning framework that dynamically forges environment, policy, and reward models through closed-loop optimization, amplifying learning signals and strengthening the overall RL system for LLM and agentic scenarios.
 
 
 
 
 
12
 
13
+ ## Key Features
14
+ * **Integrated Feedback for Policy:** The policy is trained with integrated feedback from step-wise and outcome signals, rather than outcome only.
15
+ * **Consistency Feedback for Reward Model:** The reward model is jointly optimized via consistency feedback, which in turn further improves policy training.
16
+ * **Critic Feedback for Environment:** Theory-motivated automatic environment adaptation improves training for both the reward and policy models by leveraging critic feedback from each, enabling learning from experience.
17
 
18
  <p align="center">
19
  <img src="https://github.com/yinjjiew/Data/raw/main/rlanything/rlanythingoverview.png" width="100%"/>
20
  </p>
21
 
22
+ ## Results
23
+ Empirically, each added component consistently improves the overall system, and RLAnything yields substantial gains across various representative LLM and agentic tasks, boosting Qwen3-VL-8B-Thinking by 9.1% on OSWorld and Qwen2.5-7B-Instruct by 18.7% and 11.9% on AlfWorld and LiveBench, respectively.
24
 
25
  <p align="center">
26
  <img src="https://github.com/yinjjiew/Data/raw/main/rlanything/rlanythingmaintable.png" width="100%"/>
27
  </p>
28
 
29
+ ## Citation
30
 
31
+ ```bibtex
 
 
 
 
32
  @article{wang2026rlanything,
33
  title={RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL System},
34
  author={Wang, Yinjie and Xie, Tianbao and Shen, Ke and Wang, Mengdi and Yang, Ling},
35
  journal={arXiv preprint arXiv:2602.02488},
36
  year={2026}
37
  }
38
+ ```