nielsr HF Staff commited on
Commit
70e473f
·
verified ·
1 Parent(s): dd2fc7c

Add model card for Agent-STAR-RL-1.5B

Browse files

Hi! I'm Niels from the community science team at Hugging Face.

This PR improves the model card for **Agent-STAR-RL-1.5B**. Key updates include:
- Adding relevant metadata (`pipeline_tag`, `library_name`, `base_model`).
- Linking the model to the original research paper: [Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe](https://huggingface.co/papers/2603.21972).
- Providing a link to the official GitHub repository and related datasets.
- Including a sample inference usage snippet found in the GitHub documentation.
- Adding the BibTeX citation.

Files changed (1) hide show
  1. README.md +65 -3
README.md CHANGED
@@ -1,3 +1,65 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
6
+ tags:
7
+ - tool-use
8
+ - reinforcement-learning
9
+ - agent
10
+ - travel-planning
11
+ ---
12
+
13
+ # Agent-STAR-RL-1.5B
14
+
15
+ This repository contains the **Agent-STAR-RL-1.5B** model, which is part of the research presented in the paper "[Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe](https://huggingface.co/papers/2603.21972)".
16
+
17
+ Agent-STAR is a systematic study of the reinforcement learning (RL) design space for long-horizon tool-using agents using the [TravelPlanner](https://github.com/OSU-NLP-Group/TravelPlanner/) testbed. The model is trained using the **STAR** pipeline: **Data Synthesis → SFT → RL**.
18
+
19
+ ## Model Details
20
+
21
+ - **Backbone:** Qwen2.5-1.5B-Instruct
22
+ - **Training Stage:** Reinforcement Learning (RL)
23
+ - **Primary Task:** Long-horizon tool orchestration and planning.
24
+ - **Paper:** [Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe](https://huggingface.co/papers/2603.21972)
25
+ - **Repository:** [GitHub - Agent-STAR](https://github.com/WxxShirley/Agent-STAR)
26
+ - **Dataset:** [Agent-STAR-TravelDataset](https://huggingface.co/datasets/xxwu/Agent-STAR-TravelDataset)
27
+
28
+ According to the paper's findings, smaller models like this 1.5B variant benefit from scale-aware recipes including staged (curriculum-style) rewards and enhanced exploration to handle the complex constraints of multi-turn environments.
29
+
30
+ ## Usage
31
+
32
+ To run ReAct inference using the official implementation, you can use the following command structure:
33
+
34
+ ```shell
35
+ cd Inference
36
+ python3 -u main.py \
37
+ --model xxwu/Agent-STAR-RL-1.5B \
38
+ --save_suffix your_suffix \
39
+ --max_workers 20 \
40
+ --split validation \
41
+ --max_context 32768 \
42
+ --max_turns 60
43
+ ```
44
+
45
+ Note: You will need to prepare the [travel database](https://huggingface.co/datasets/xxwu/Agent-STAR-TravelDatabase) as described in the GitHub repository.
46
+
47
+ ## Citation
48
+
49
+ If you find Agent-STAR helpful to your work, please cite the following:
50
+
51
+ ```bibtex
52
+ @misc{wu2026agentstar,
53
+ title={Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe},
54
+ author={Xixi Wu and Qianguo Sun and Ruiyang Zhang and Chao Song and Junlong Wu and Yiyan Qi and Hong Cheng},
55
+ year={2026},
56
+ eprint={2603.21972},
57
+ archivePrefix={arXiv},
58
+ primaryClass={cs.LG},
59
+ url={https://arxiv.org/abs/2603.21972},
60
+ }
61
+ ```
62
+
63
+ ## Acknowledgements
64
+
65
+ We thank the authors of [TravelPlanner](https://github.com/OSU-NLP-Group/TravelPlanner/) for their benchmark and the [rLLM](https://github.com/rllm-org/rllm/) framework contributors for supporting the RL training process.