Update README.md
Browse files
README.md
CHANGED
|
@@ -50,24 +50,10 @@ SAP-4B is a 4B-parameter agentic language model specialized in **long-horizon mu
|
|
| 50 |
|
| 51 |
---
|
| 52 |
|
| 53 |
-
### Performance Note
|
| 54 |
-
- The paper has been submitted to EMNLP 2026, and its reported results use the benchmark evaluation setting available at the time of submission.
|
| 55 |
-
- For BFCL v4 Multi-Turn: subsequent updates to the evaluation setting led to minor subset-level score fluctuations in the latest re-evaluation, while the overall average performance remains consistent with the paper's conclusions. Fluctuations are purely caused by evaluation pipeline adjustments (stricter matching rules for base/long-context subsets, more favorable calibration for robustness subsets), with no changes to the model or training data.
|
| 56 |
-
- For τ²-bench: only the submission-version result is currently available; re-evaluation under an updated setting may produce slightly different subset-level scores.
|
| 57 |
-
- The paper's core finding — that argument-provenance grounded SFT significantly improves long-horizon tool-use performance without requiring RL — remains fully valid.
|
| 58 |
-
|
| 59 |
-
---
|
| 60 |
-
|
| 61 |
## Key Capabilities
|
| 62 |
1. **Cross-turn argument grounding**: Consistently sources tool argument values from verifiable upstream context (prior tool returns, initial state, user messages) rather than hallucinating parameters.
|
| 63 |
2. **Long-horizon task execution**: Handles multi-step tool workflows across long context windows, maintaining dependency chains across turns.
|
| 64 |
3. **Deployment robustness**: Performs reliably in missing-parameter and missing-function challenge scenarios that mimic real-world imperfect inputs.
|
| 65 |
4. **No single-turn performance degradation**: Multi-turn specialization does not hurt single-turn function calling performance, with small consistent gains on single-turn BFCL v4 splits.
|
| 66 |
|
| 67 |
-
---
|
| 68 |
|
| 69 |
-
## Intended Use Cases
|
| 70 |
-
- Multi-turn agentic tool calling and function invocation tasks
|
| 71 |
-
- Long-horizon workflow automation requiring sequential tool use
|
| 72 |
-
- Research on argument-level dependency modeling for tool-use agents
|
| 73 |
-
- Baseline for 4B-scale agent model development
|
|
|
|
| 50 |
|
| 51 |
---
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
## Key Capabilities
|
| 54 |
1. **Cross-turn argument grounding**: Consistently sources tool argument values from verifiable upstream context (prior tool returns, initial state, user messages) rather than hallucinating parameters.
|
| 55 |
2. **Long-horizon task execution**: Handles multi-step tool workflows across long context windows, maintaining dependency chains across turns.
|
| 56 |
3. **Deployment robustness**: Performs reliably in missing-parameter and missing-function challenge scenarios that mimic real-world imperfect inputs.
|
| 57 |
4. **No single-turn performance degradation**: Multi-turn specialization does not hurt single-turn function calling performance, with small consistent gains on single-turn BFCL v4 splits.
|
| 58 |
|
|
|
|
| 59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|