Update model card: fix SGLang heading, add Model Information, license, hardware, and inference settings
Browse files
README.md
CHANGED
|
@@ -3,6 +3,8 @@ language:
|
|
| 3 |
- en
|
| 4 |
- zh
|
| 5 |
license: other
|
|
|
|
|
|
|
| 6 |
pipeline_tag: image-text-to-text
|
| 7 |
tags:
|
| 8 |
- agnes-ai
|
|
@@ -76,13 +78,49 @@ Agnes 2.5 Pro Alpha is evaluated against the same comparison set selected for Or
|
|
| 76 |
† GDPval-AA v2 uses Artificial Analysis' normalized score, <code>(Elo − 500) / 2000</code>. Non-Hallucination Rate is <code>1 − hallucination rate</code>. Higher is better for every benchmark. Snapshot checked August 18, 2026; values may change as evaluations are updated.
|
| 77 |
</p>
|
| 78 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 79 |
## Quickstart
|
| 80 |
|
| 81 |
<div style="border-left:4px solid #3248AF;background:rgba(50,72,175,.08);border-radius:6px;padding:12px 16px;font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,sans-serif;font-size:14px;line-height:1.6">
|
| 82 |
<div style="font-weight:700;color:#3248AF;margin-bottom:6px">REASONING MODEL</div>
|
| 83 |
<p style="margin:0"><b>Agnes 2.5 Pro Alpha</b> uses extended reasoning for complex tasks and is available through OpenAI-compatible Chat Completions and Responses APIs. Keep API keys in environment variables and use publicly accessible URLs for image inputs.</p>
|
| 84 |
</div>
|
| 85 |
-
|
|
|
|
| 86 |
|
| 87 |
```bash
|
| 88 |
python -m sglang.launch_server \
|
|
@@ -180,6 +218,20 @@ curl https://apihub.agnes-ai.com/v1/responses \
|
|
| 180 |
}'
|
| 181 |
```
|
| 182 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 183 |
## Model Capabilities
|
| 184 |
|
| 185 |
| Capability | Support |
|
|
|
|
| 3 |
- en
|
| 4 |
- zh
|
| 5 |
license: other
|
| 6 |
+
license_name: agnes-ai-terms-of-use
|
| 7 |
+
license_link: https://agnes-ai.com/
|
| 8 |
pipeline_tag: image-text-to-text
|
| 9 |
tags:
|
| 10 |
- agnes-ai
|
|
|
|
| 78 |
† GDPval-AA v2 uses Artificial Analysis' normalized score, <code>(Elo − 500) / 2000</code>. Non-Hallucination Rate is <code>1 − hallucination rate</code>. Higher is better for every benchmark. Snapshot checked August 18, 2026; values may change as evaluations are updated.
|
| 79 |
</p>
|
| 80 |
|
| 81 |
+
## Model Information
|
| 82 |
+
|
| 83 |
+
| Property | Value |
|
| 84 |
+
|---|---|
|
| 85 |
+
| Developed by | Agnes AI |
|
| 86 |
+
| Model name | Agnes 2.5 Pro Alpha |
|
| 87 |
+
| Model type | Proprietary multimodal reasoning model |
|
| 88 |
+
| Languages | English, Chinese |
|
| 89 |
+
| Context window | 1,048,576 tokens |
|
| 90 |
+
| Maximum output | 65,536 tokens |
|
| 91 |
+
| Input modalities | Text, image |
|
| 92 |
+
| Output modality | Text |
|
| 93 |
+
| Precision | BF16 |
|
| 94 |
+
| Tool calling | Yes |
|
| 95 |
+
| Streaming | Yes |
|
| 96 |
+
| Release date | July 2026 |
|
| 97 |
+
|
| 98 |
+
## License
|
| 99 |
+
|
| 100 |
+
This model is released under the **Agnes AI Terms of Use** (`license: other`). It is not licensed as Apache-2.0, MIT, or any other OSI open-source license.
|
| 101 |
+
|
| 102 |
+
Use of the weights in this repository and of the hosted API is subject to the [Agnes AI](https://agnes-ai.com/) terms. For commercial licensing questions, contact [support@agnes-ai.com](mailto:support@agnes-ai.com).
|
| 103 |
+
|
| 104 |
+
## Hardware Requirements
|
| 105 |
+
|
| 106 |
+
The Quickstart launch command uses 8-GPU tensor parallelism. The checkpoint is a large multi-shard BF16 package; a single GPU is not sufficient.
|
| 107 |
+
|
| 108 |
+
| Resource | Recommendation |
|
| 109 |
+
|---|---|
|
| 110 |
+
| GPUs | 8× NVIDIA H200 (141 GB) or equivalent |
|
| 111 |
+
| Tensor parallel | `--tp 8` |
|
| 112 |
+
| Host memory / disk | Fast NVMe with about **1 TB** free for weights, tokenizer files, and download cache |
|
| 113 |
+
| Context length | The sample command sets `--context-length 1024000`. If you hit out-of-memory errors, lower this value |
|
| 114 |
+
| Network | Optional. The same model is also served at `https://apihub.agnes-ai.com/v1` without local GPUs |
|
| 115 |
+
|
| 116 |
## Quickstart
|
| 117 |
|
| 118 |
<div style="border-left:4px solid #3248AF;background:rgba(50,72,175,.08);border-radius:6px;padding:12px 16px;font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,sans-serif;font-size:14px;line-height:1.6">
|
| 119 |
<div style="font-weight:700;color:#3248AF;margin-bottom:6px">REASONING MODEL</div>
|
| 120 |
<p style="margin:0"><b>Agnes 2.5 Pro Alpha</b> uses extended reasoning for complex tasks and is available through OpenAI-compatible Chat Completions and Responses APIs. Keep API keys in environment variables and use publicly accessible URLs for image inputs.</p>
|
| 121 |
</div>
|
| 122 |
+
|
| 123 |
+
<h3>SGLang</h3>
|
| 124 |
|
| 125 |
```bash
|
| 126 |
python -m sglang.launch_server \
|
|
|
|
| 218 |
}'
|
| 219 |
```
|
| 220 |
|
| 221 |
+
## Recommended Inference Settings
|
| 222 |
+
|
| 223 |
+
Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
|
| 224 |
+
|
| 225 |
+
| Setting | Default | Coding and tool use |
|
| 226 |
+
|---|---|---|
|
| 227 |
+
| `temperature` | 1.0 | 0.2–0.3 |
|
| 228 |
+
| `top_p` | 0.95 | 0.95 |
|
| 229 |
+
| `top_k` | 20 | 20 |
|
| 230 |
+
| `repetition_penalty` | 1.05 | 1.05 |
|
| 231 |
+
| `max_tokens` | 2000 or higher | 2000 or higher |
|
| 232 |
+
|
| 233 |
+
The coding examples in Quickstart use `temperature` 0.2 (Chat Completions) and 0.3 (Python). Raise `max_tokens` if a response stops early.
|
| 234 |
+
|
| 235 |
## Model Capabilities
|
| 236 |
|
| 237 |
| Capability | Support |
|