Agnes-AI commited on
Commit
4bd5c69
·
verified ·
1 Parent(s): 2b23af0

Update model card: fix SGLang heading, add Model Information, license, hardware, and inference settings

Browse files
Files changed (1) hide show
  1. README.md +53 -1
README.md CHANGED
@@ -3,6 +3,8 @@ language:
3
  - en
4
  - zh
5
  license: other
 
 
6
  pipeline_tag: image-text-to-text
7
  tags:
8
  - agnes-ai
@@ -76,13 +78,49 @@ Agnes 2.5 Pro Alpha is evaluated against the same comparison set selected for Or
76
  † GDPval-AA v2 uses Artificial Analysis' normalized score, <code>(Elo − 500) / 2000</code>. Non-Hallucination Rate is <code>1 − hallucination rate</code>. Higher is better for every benchmark. Snapshot checked August 18, 2026; values may change as evaluations are updated.
77
  </p>
78
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
79
  ## Quickstart
80
 
81
  <div style="border-left:4px solid #3248AF;background:rgba(50,72,175,.08);border-radius:6px;padding:12px 16px;font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,sans-serif;font-size:14px;line-height:1.6">
82
  <div style="font-weight:700;color:#3248AF;margin-bottom:6px">REASONING MODEL</div>
83
  <p style="margin:0"><b>Agnes 2.5 Pro Alpha</b> uses extended reasoning for complex tasks and is available through OpenAI-compatible Chat Completions and Responses APIs. Keep API keys in environment variables and use publicly accessible URLs for image inputs.</p>
84
  </div>
85
- ### SGLang
 
86
 
87
  ```bash
88
  python -m sglang.launch_server \
@@ -180,6 +218,20 @@ curl https://apihub.agnes-ai.com/v1/responses \
180
  }'
181
  ```
182
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
183
  ## Model Capabilities
184
 
185
  | Capability | Support |
 
3
  - en
4
  - zh
5
  license: other
6
+ license_name: agnes-ai-terms-of-use
7
+ license_link: https://agnes-ai.com/
8
  pipeline_tag: image-text-to-text
9
  tags:
10
  - agnes-ai
 
78
  † GDPval-AA v2 uses Artificial Analysis' normalized score, <code>(Elo − 500) / 2000</code>. Non-Hallucination Rate is <code>1 − hallucination rate</code>. Higher is better for every benchmark. Snapshot checked August 18, 2026; values may change as evaluations are updated.
79
  </p>
80
 
81
+ ## Model Information
82
+
83
+ | Property | Value |
84
+ |---|---|
85
+ | Developed by | Agnes AI |
86
+ | Model name | Agnes 2.5 Pro Alpha |
87
+ | Model type | Proprietary multimodal reasoning model |
88
+ | Languages | English, Chinese |
89
+ | Context window | 1,048,576 tokens |
90
+ | Maximum output | 65,536 tokens |
91
+ | Input modalities | Text, image |
92
+ | Output modality | Text |
93
+ | Precision | BF16 |
94
+ | Tool calling | Yes |
95
+ | Streaming | Yes |
96
+ | Release date | July 2026 |
97
+
98
+ ## License
99
+
100
+ This model is released under the **Agnes AI Terms of Use** (`license: other`). It is not licensed as Apache-2.0, MIT, or any other OSI open-source license.
101
+
102
+ Use of the weights in this repository and of the hosted API is subject to the [Agnes AI](https://agnes-ai.com/) terms. For commercial licensing questions, contact [support@agnes-ai.com](mailto:support@agnes-ai.com).
103
+
104
+ ## Hardware Requirements
105
+
106
+ The Quickstart launch command uses 8-GPU tensor parallelism. The checkpoint is a large multi-shard BF16 package; a single GPU is not sufficient.
107
+
108
+ | Resource | Recommendation |
109
+ |---|---|
110
+ | GPUs | 8× NVIDIA H200 (141 GB) or equivalent |
111
+ | Tensor parallel | `--tp 8` |
112
+ | Host memory / disk | Fast NVMe with about **1 TB** free for weights, tokenizer files, and download cache |
113
+ | Context length | The sample command sets `--context-length 1024000`. If you hit out-of-memory errors, lower this value |
114
+ | Network | Optional. The same model is also served at `https://apihub.agnes-ai.com/v1` without local GPUs |
115
+
116
  ## Quickstart
117
 
118
  <div style="border-left:4px solid #3248AF;background:rgba(50,72,175,.08);border-radius:6px;padding:12px 16px;font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,sans-serif;font-size:14px;line-height:1.6">
119
  <div style="font-weight:700;color:#3248AF;margin-bottom:6px">REASONING MODEL</div>
120
  <p style="margin:0"><b>Agnes 2.5 Pro Alpha</b> uses extended reasoning for complex tasks and is available through OpenAI-compatible Chat Completions and Responses APIs. Keep API keys in environment variables and use publicly accessible URLs for image inputs.</p>
121
  </div>
122
+
123
+ <h3>SGLang</h3>
124
 
125
  ```bash
126
  python -m sglang.launch_server \
 
218
  }'
219
  ```
220
 
221
+ ## Recommended Inference Settings
222
+
223
+ Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
224
+
225
+ | Setting | Default | Coding and tool use |
226
+ |---|---|---|
227
+ | `temperature` | 1.0 | 0.2–0.3 |
228
+ | `top_p` | 0.95 | 0.95 |
229
+ | `top_k` | 20 | 20 |
230
+ | `repetition_penalty` | 1.05 | 1.05 |
231
+ | `max_tokens` | 2000 or higher | 2000 or higher |
232
+
233
+ The coding examples in Quickstart use `temperature` 0.2 (Chat Completions) and 0.3 (Python). Raise `max_tokens` if a response stops early.
234
+
235
  ## Model Capabilities
236
 
237
  | Capability | Support |