Kfkcome nielsr HF Staff commited on
Commit
38d5de8
·
verified ·
1 Parent(s): 43b4238

Add model card and metadata (#1)

Browse files

- Add model card and metadata (af931d877f10fc3321d308d84a32c712b1012c68)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ base_model: Qwen/Qwen2.5-7B-Instruct
5
+ tags:
6
+ - tool-use
7
+ - agent
8
+ - reinforcement-learning
9
+ ---
10
+ ---
11
+
12
+ # ToolMaster-7B
13
+
14
+ ToolMaster is a framework that shifts tool learning from static imitation to a **trial-and-execution paradigm**, enabling Large Language Models (LLMs) to actively master tools. It was introduced in the paper [Teaching LLMs to Learn Tool Trialing and Execution through Environment Interaction](https://huggingface.co/papers/2601.12762).
15
+
16
+ ## Introduction
17
+
18
+ Existing tool-use paradigms primarily rely on memorizing static solution paths during training, which limits the ability of LLMs to generalize to new or evolving tools. ToolMaster addresses this by training agents to:
19
+ 1. **Trial Phase**: Conduct autonomous tool trials to accumulate experiential knowledge.
20
+ 2. **Execution Phase**: Perform planning and solving while explicitly employing self-correction to rectify errors based on environmental feedback.
21
+
22
+ By leveraging Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) using Group Relative Policy Optimization (GRPO), ToolMaster empowers agents to dynamically adapt to unfamiliar tools, significantly enhancing generalization and robustness.
23
+
24
+ ## Resources
25
+
26
+ - **Paper**: [Teaching LLMs to Learn Tool Trialing and Execution through Environment Interaction](https://huggingface.co/papers/2601.12762)
27
+ - **Repository**: [https://github.com/NEUIR/ToolMaster](https://github.com/NEUIR/ToolMaster)
28
+
29
+ ## Model Details
30
+
31
+ This checkpoint is a fine-tuned version of **Qwen2.5-7B-Instruct**. It has been optimized for tool planning and invocation through the trial-and-execution framework.
32
+
33
+ ## Usage
34
+
35
+ For detailed instructions on environment setup, data preparation, and evaluation (on benchmarks like ToolHop, TMDB, and StableToolBench), please refer to the [official GitHub repository](https://github.com/NEUIR/ToolMaster).
36
+
37
+ ## Citation
38
+
39
+ If you find this work useful, please cite:
40
+
41
+ ```bibtex
42
+ @article{gao2025teaching,
43
+ title={Teaching LLMs to Learn Tool Trialing and Execution through Environment Interaction},
44
+ author={Gao, Xingjie and others},
45
+ journal={arXiv preprint arXiv:2601.12762},
46
+ year={2025}
47
+ }
48
+ ```