Commit History

Use chat_template.jinja as the single source: drop the {% include %} chat_template field from tokenizer_config.json
2ce6e7f
verified

joerowell commited on

small self-contained fixes
87833b4
verified

joerowell commited on

Document SGLang support (sgl-project/sglang#24204)
1a9a5d4
verified

joerowell commited on

Note FP8 KV cache needs vLLM 0.22.0; drop scrambled-output workaround (vllm#42650)
88ad86d

joerowell commited on

update sampling parameters to match evals
f854f41

joerowell commited on

Update model card for 256K context length
039231a
verified

varunrandery commited on

increase context length to 256k
df25fd0

joerowell commited on

Drop VLLM_USE_DEEP_GEMM=0 from vllm serve recipe (DeepGEMM is supported on Hopper and datacenter Blackwell)
b17bd8d
verified

joerowell commited on

Enable thinking by default in non-Hopper FP8-KV serve command
e8b30a7
verified

joerowell commited on

Update non-Hopper FP8-KV serve command and link to vLLM recipes page
2ad0232
verified

joerowell commited on

Laguna XS.2 upload
fba1514

joerowell commited on