Set recommended temperature to 1.0 for all workloads
Browse files
README.md
CHANGED
|
@@ -150,7 +150,7 @@ curl https://apihub.agnes-ai.com/v1/chat/completions \
|
|
| 150 |
"content": "Review this API handler for security issues and provide a corrected version."
|
| 151 |
}
|
| 152 |
],
|
| 153 |
-
"temperature":
|
| 154 |
"max_tokens": 2000
|
| 155 |
}'
|
| 156 |
```
|
|
@@ -178,7 +178,7 @@ response = client.chat.completions.create(
|
|
| 178 |
"content": "Design a fault-tolerant event processing architecture.",
|
| 179 |
}
|
| 180 |
],
|
| 181 |
-
temperature=
|
| 182 |
max_tokens=2000,
|
| 183 |
)
|
| 184 |
|
|
@@ -222,15 +222,15 @@ curl https://apihub.agnes-ai.com/v1/responses \
|
|
| 222 |
|
| 223 |
Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
|
| 224 |
|
| 225 |
-
| Setting |
|
| 226 |
-
|---|---|
|
| 227 |
-
| `temperature` | 1.0 |
|
| 228 |
-
| `top_p` | 0.95 |
|
| 229 |
-
| `top_k` | 20 |
|
| 230 |
-
| `repetition_penalty` | 1.05 |
|
| 231 |
-
| `max_tokens` | 2000 or higher |
|
| 232 |
|
| 233 |
-
|
| 234 |
|
| 235 |
## Model Capabilities
|
| 236 |
|
|
|
|
| 150 |
"content": "Review this API handler for security issues and provide a corrected version."
|
| 151 |
}
|
| 152 |
],
|
| 153 |
+
"temperature": 1.0,
|
| 154 |
"max_tokens": 2000
|
| 155 |
}'
|
| 156 |
```
|
|
|
|
| 178 |
"content": "Design a fault-tolerant event processing architecture.",
|
| 179 |
}
|
| 180 |
],
|
| 181 |
+
temperature=1.0,
|
| 182 |
max_tokens=2000,
|
| 183 |
)
|
| 184 |
|
|
|
|
| 222 |
|
| 223 |
Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
|
| 224 |
|
| 225 |
+
| Setting | Recommended |
|
| 226 |
+
|---|---|
|
| 227 |
+
| `temperature` | 1.0 |
|
| 228 |
+
| `top_p` | 0.95 |
|
| 229 |
+
| `top_k` | 20 |
|
| 230 |
+
| `repetition_penalty` | 1.05 |
|
| 231 |
+
| `max_tokens` | 2000 or higher |
|
| 232 |
|
| 233 |
+
Raise `max_tokens` if a response stops early.
|
| 234 |
|
| 235 |
## Model Capabilities
|
| 236 |
|