347 kB

Ctrl+K

1 contributor

History: 1 commit

a1exxd0

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified about 2 months ago

quantization
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
speculative_decoding
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
README.md

5.24 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
automatic_prefix_caching.md

2.17 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
batch_invariance.md

4.78 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
context_extension.md

2.48 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
custom_arguments.md

1.87 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
custom_logitsprocs.md

28 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
disagg_encoder.md

3.27 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
disagg_prefill.md

7.85 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
index_cache.md

2.56 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
interleaved_thinking.md

4.23 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
lora.md

19.7 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
mooncake_connector_usage.md

3.11 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
mooncake_store_connector_usage.md

8.76 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
moriio_connector_usage.md

11 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
multimodal_inputs.md

40.6 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
nixl_connector_compatibility.md

5.46 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
nixl_connector_usage.md

18.4 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
prompt_embeds.md

4.24 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
reasoning_outputs.md

19.9 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
sleep_mode.md

5.49 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
structured_outputs.md

13.7 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
tool_calling.md

26.4 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago