add README.md

README.md

@@ -134,7 +134,7 @@ curl http://127.0.0.1:8000/v1/chat/completions -H "Content-Type: application/jso
 ```
 The answer is the single output token; `top_logprobs` gives the probabilities (e.g. `Y 0.99`, `N 0.01`).
 
-Seb-9B-v2 was trained and evaluated with prompts of up to 1,024 tokens; `--max-model-len` above only sets the server's limit.
+Context: up to 32,768 tokens. The System One server and client default to 1,024 tokens, so for longer inputs start the server with `SYSTEM1_MAX_CONTEXT_TOKENS=32768 SYSTEM1_MAX_PAYLOAD_CHARS=262144` (and vLLM with `--max-model-len 32768`, as above). The Decision Index run used exactly that setting: 110,352 of 110,520 requests fit, including contract documents of 6k+ tokens, and the 168 that did not fit count as wrong. The speed numbers above are for prompts up to 1,024 tokens; longer prompts take longer.
 
 ### System One API