Update README.md
Browse files
README.md
CHANGED
|
@@ -22,3 +22,23 @@ Quantization was performed using [exllama3 v0.0.20](https://github.com/turboderp
|
|
| 22 |
| [7.0bpw](https://huggingface.co/NeuroSenko/Qwen3-Coder-Next-exl3/tree/7.0bpw) | 66 | 0.10106506 | 0.10081614 | 19.61846442 | 0.8730 | 0.6666 | 0.4614 | 0.2983 | 0.1821 |
|
| 23 |
| [8.0bpw](https://huggingface.co/NeuroSenko/Qwen3-Coder-Next-exl3/tree/8.0bpw) | 75 | 0.13291914 | 0.13419860 | 19.85572412 | 0.8631 | 0.6503 | 0.4468 | 0.2885 | 0.1771 |
|
| 24 |
| original | 148 | - | - | 19.78538866 | - | - | - | - | - |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
| [7.0bpw](https://huggingface.co/NeuroSenko/Qwen3-Coder-Next-exl3/tree/7.0bpw) | 66 | 0.10106506 | 0.10081614 | 19.61846442 | 0.8730 | 0.6666 | 0.4614 | 0.2983 | 0.1821 |
|
| 23 |
| [8.0bpw](https://huggingface.co/NeuroSenko/Qwen3-Coder-Next-exl3/tree/8.0bpw) | 75 | 0.13291914 | 0.13419860 | 19.85572412 | 0.8631 | 0.6503 | 0.4468 | 0.2885 | 0.1771 |
|
| 24 |
| original | 148 | - | - | 19.78538866 | - | - | - | - | - |
|
| 25 |
+
|
| 26 |
+
## Tool Calls Support for Qwen/GLM Models
|
| 27 |
+
|
| 28 |
+
The official tabbyAPI doesn't support tool calls for Qwen and GLM models yet.
|
| 29 |
+
|
| 30 |
+
If you're using Qwen-Code, OpenClaw, or similar software that need tool call support, you can use [my fork](https://github.com/NeuroSenko/tabbyAPI/tree/tools-support) with the `tools-support` branch:
|
| 31 |
+
|
| 32 |
+
**Clone directly:**
|
| 33 |
+
```bash
|
| 34 |
+
git clone -b tools-support https://github.com/NeuroSenko/tabbyAPI
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
**Or add to existing tabbyAPI installation:**
|
| 38 |
+
```bash
|
| 39 |
+
git remote add neurosenko https://github.com/NeuroSenko/tabbyAPI
|
| 40 |
+
git fetch neurosenko
|
| 41 |
+
git checkout -b tools-support neurosenko/tools-support
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
This branch includes native tool calling support for Qwen and GLM model families.
|