Improve model card: add paper link, repository link, and model description

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +44 -16
README.md CHANGED
@@ -1,34 +1,51 @@
1
  ---
 
2
  library_name: transformers
3
  license: other
4
- base_model: Qwen/Qwen2.5-3B-Instruct
5
  tags:
6
  - llama-factory
7
  - full
8
  - generated_from_trainer
 
 
 
9
  model-index:
10
  - name: TravelPlanner_Instruct_3B_1128_1K_4Epoch
11
  results: []
12
  ---
13
 
14
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
- should probably proofread and complete it, then remove this comment. -->
16
-
17
- # TravelPlanner_Instruct_3B_1128_1K_4Epoch
18
 
19
- This model is a fine-tuned version of [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct) on the travelplanner_1108_5k_filter_1128_1k dataset.
20
 
21
  ## Model description
22
 
23
- More information needed
 
 
 
 
 
 
24
 
25
  ## Intended uses & limitations
26
 
27
- More information needed
28
 
29
- ## Training and evaluation data
30
 
31
- More information needed
 
 
 
 
 
 
 
 
 
 
32
 
33
  ## Training procedure
34
 
@@ -43,19 +60,30 @@ The following hyperparameters were used during training:
43
  - num_devices: 8
44
  - gradient_accumulation_steps: 4
45
  - total_train_batch_size: 32
46
- - total_eval_batch_size: 64
47
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: cosine
49
  - lr_scheduler_warmup_ratio: 0.1
50
  - num_epochs: 4.0
51
 
52
- ### Training results
53
-
54
-
55
-
56
  ### Framework versions
57
 
58
  - Transformers 4.57.1
59
  - Pytorch 2.9.0+cu128
60
  - Datasets 4.0.0
61
  - Tokenizers 0.22.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: Qwen/Qwen2.5-3B-Instruct
3
  library_name: transformers
4
  license: other
5
+ pipeline_tag: text-generation
6
  tags:
7
  - llama-factory
8
  - full
9
  - generated_from_trainer
10
+ - agent
11
+ - tool-use
12
+ - long-horizon-planning
13
  model-index:
14
  - name: TravelPlanner_Instruct_3B_1128_1K_4Epoch
15
  results: []
16
  ---
17
 
18
+ # TravelPlanner_Instruct_3B_1128_1K_4Epoch (Agent-STAR-SFT-3B)
 
 
 
19
 
20
+ This model is a fine-tuned version of [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct) and is part of the **Agent-STAR** project. It corresponds to the **STAR-SFT-3B** stage described in the paper: [Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe](https://huggingface.co/papers/2603.21972).
21
 
22
  ## Model description
23
 
24
+ **Agent-STAR** is a systematic framework designed to evolve Large Language Models into autonomous agents capable of long-horizon planning and tool orchestration. This specific checkpoint represents the Supervised Fine-Tuning (SFT) stage of the **STAR [Data Synthesis → SFT → RL]** pipeline.
25
+
26
+ It was fine-tuned from the Qwen2.5-Instruct base using **1K successful trajectories** generated by stronger models (DeepSeek-V3.2-Exp-Thinking) on synthetic travel planning queries. The model is optimized to satisfy multifaceted constraints (commonsense and hard constraints) in multi-turn environments like the TravelPlanner benchmark.
27
+
28
+ - **Paper:** [Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe](https://huggingface.co/papers/2603.21972)
29
+ - **Repository:** [https://github.com/WxxShirley/Agent-STAR](https://github.com/WxxShirley/Agent-STAR)
30
+ - **Point of Contact:** [Xixi Wu](mailto:xxwu@se.cuhk.edu.hk)
31
 
32
  ## Intended uses & limitations
33
 
34
+ The model is intended for research on agentic LLMs, particularly those requiring tool use and multi-step planning. While it achieves high performance on travel planning tasks, users should be aware of typical LLM limitations regarding factual consistency and potential biases.
35
 
36
+ ## Usage
37
 
38
+ To run ReAct inference with this model, you can use the following command structure from the official repository:
39
+
40
+ ```bash
41
+ python3 -u main.py \
42
+ --model xxwu/TravelPlanner_Instruct_3B_1128_1K_4Epoch \
43
+ --save_suffix your_experiment_name \
44
+ --max_workers 20 \
45
+ --split validation \
46
+ --max_context 32768 \
47
+ --max_turns 60
48
+ ```
49
 
50
  ## Training procedure
51
 
 
60
  - num_devices: 8
61
  - gradient_accumulation_steps: 4
62
  - total_train_batch_size: 32
63
+ - optimizer: AdamW (fused)
 
64
  - lr_scheduler_type: cosine
65
  - lr_scheduler_warmup_ratio: 0.1
66
  - num_epochs: 4.0
67
 
 
 
 
 
68
  ### Framework versions
69
 
70
  - Transformers 4.57.1
71
  - Pytorch 2.9.0+cu128
72
  - Datasets 4.0.0
73
  - Tokenizers 0.22.1
74
+
75
+ ## Citation
76
+
77
+ If you find Agent-STAR helpful to your work, please cite:
78
+
79
+ ```bibtex
80
+ @misc{wu2026agentstar,
81
+ title={Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe},
82
+ author={Xixi Wu and Qianguo Sun and Ruiyang Zhang and Chao Song and Junlong Wu and Yiyan Qi and Hong Cheng},
83
+ year={2026},
84
+ eprint={2603.21972},
85
+ archivePrefix={arXiv},
86
+ primaryClass={cs.LG},
87
+ url={https://arxiv.org/abs/2603.21972},
88
+ }
89
+ ```