Agnes-AI commited on
Commit
bcd480d
·
verified ·
1 Parent(s): 4bd5c69

Set recommended temperature to 1.0 for all workloads

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -150,7 +150,7 @@ curl https://apihub.agnes-ai.com/v1/chat/completions \
150
  "content": "Review this API handler for security issues and provide a corrected version."
151
  }
152
  ],
153
- "temperature": 0.2,
154
  "max_tokens": 2000
155
  }'
156
  ```
@@ -178,7 +178,7 @@ response = client.chat.completions.create(
178
  "content": "Design a fault-tolerant event processing architecture.",
179
  }
180
  ],
181
- temperature=0.3,
182
  max_tokens=2000,
183
  )
184
 
@@ -222,15 +222,15 @@ curl https://apihub.agnes-ai.com/v1/responses \
222
 
223
  Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
224
 
225
- | Setting | Default | Coding and tool use |
226
- |---|---|---|
227
- | `temperature` | 1.0 | 0.2–0.3 |
228
- | `top_p` | 0.95 | 0.95 |
229
- | `top_k` | 20 | 20 |
230
- | `repetition_penalty` | 1.05 | 1.05 |
231
- | `max_tokens` | 2000 or higher | 2000 or higher |
232
 
233
- The coding examples in Quickstart use `temperature` 0.2 (Chat Completions) and 0.3 (Python). Raise `max_tokens` if a response stops early.
234
 
235
  ## Model Capabilities
236
 
 
150
  "content": "Review this API handler for security issues and provide a corrected version."
151
  }
152
  ],
153
+ "temperature": 1.0,
154
  "max_tokens": 2000
155
  }'
156
  ```
 
178
  "content": "Design a fault-tolerant event processing architecture.",
179
  }
180
  ],
181
+ temperature=1.0,
182
  max_tokens=2000,
183
  )
184
 
 
222
 
223
  Use sampling rather than greedy decoding. Leave enough `max_tokens` / `max_output_tokens` for extended reasoning.
224
 
225
+ | Setting | Recommended |
226
+ |---|---|
227
+ | `temperature` | 1.0 |
228
+ | `top_p` | 0.95 |
229
+ | `top_k` | 20 |
230
+ | `repetition_penalty` | 1.05 |
231
+ | `max_tokens` | 2000 or higher |
232
 
233
+ Raise `max_tokens` if a response stops early.
234
 
235
  ## Model Capabilities
236