dongguanting commited on
Commit
ba82d32
路
verified 路
1 Parent(s): 1ad06f8

Add ToolSpace model card and paper results

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md CHANGED
@@ -1,3 +1,60 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ base_model: Qwen/Qwen3-8B
4
+ library_name: transformers
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - agent
8
+ - tool-use
9
+ - function-calling
10
+ - long-horizon
11
+ - toolspace
12
+ - reinforcement-learning
13
  ---
14
+
15
+ # ToolSpace-8B
16
+
17
+ [Code](https://github.com/dongguanting/ToolSpace) 路 [Evaluation](https://github.com/dongguanting/ToolSpace/tree/main/evaluation) 路 [8B](https://huggingface.co/dongguanting/ToolSpace-8B) 路 [35B-A3B](https://huggingface.co/dongguanting/ToolSpace-35B-A3B) 路 [744B-A40B](https://huggingface.co/dongguanting/ToolSpace-744B-A40B)
18
+
19
+ ToolSpace-8B is a Qwen3-8B agent model trained with ToolSpace trajectories and on-policy agent reinforcement learning for long-horizon tool use.
20
+
21
+ ToolSpace constructs a tool-composition graph from real execution traces, capturing data, state, and retry dependencies. It synthesizes cross-environment tasks through state-aware walks with rollback and keeps trajectories that pass execution-based verification.
22
+
23
+ **Paper:** *ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents*.
24
+
25
+ ## Model information
26
+
27
+ | Item | Details |
28
+ | --- | --- |
29
+ | Backbone | Qwen3-8B |
30
+ | Architecture | Dense, 8B parameters |
31
+ | Context length | 65,536 tokens |
32
+ | Weight format | BF16 Safetensors |
33
+ | Training | Supervised fine-tuning + agent RL |
34
+
35
+ ## Results
36
+
37
+ Results from Table 1 of the ToolSpace paper. Avg. is the unweighted mean over the seven benchmarks.
38
+
39
+ | Model | AutomationBench | SkillsBench | JobBench | 蟿鲁-Bench Banking | BFCL V4 | Harvey LAB | OfficeQA Pro | Avg. |
40
+ | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
41
+ | Qwen3-8B | 0.0 | 0.1 | 0.1 | 4.1 | 42.8 | 0.0 | 3.0 | 7.2 |
42
+ | ToolSpace-8B (SFT) | 32.3 | 3.9 | 13.1 | 10.3 | 65.3 | 0.0 | 12.0 | 19.6 |
43
+ | **ToolSpace-8B + Agent RL (this checkpoint)** | 34.3 | 4.1 | 15.5 | 11.3 | 67.5 | 0.0 | 12.0 | 20.7 |
44
+
45
+ ## Usage
46
+
47
+ Serve with vLLM and the included chat template:
48
+
49
+ ```bash
50
+ vllm serve dongguanting/ToolSpace-8B \
51
+ --served-model-name ToolSpace-8B \
52
+ --max-model-len 65536 \
53
+ --enable-auto-tool-choice \
54
+ --tool-call-parser hermes \
55
+ --reasoning-parser deepseek_r1
56
+ ```
57
+
58
+ The server exposes an OpenAI-compatible endpoint at `http://localhost:8000/v1`.
59
+
60
+ Evaluation commands and benchmark configurations are available in the [ToolSpace evaluation directory](https://github.com/dongguanting/ToolSpace/tree/main/evaluation).