kv-landlords / scripts

155 kB

Ctrl+K

1 contributor

History: 1 commit

a1exxd0

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified about 1 month ago

bench_int4_kivi.py
5.77 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
bench_paged_decode.py
3.82 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
bench_quant_vs_flash.py
4.74 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
ceiling_and_mem.py
6.33 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
decode_latency_serving.py
4.26 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
diag_kernel_perchannel.py
4.54 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
humaneval_bench.py
9.78 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
int4_kivi_generate.py
7.16 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
longctx_code_bench.py
11.5 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
longctx_code_serving.py
6.48 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
longctx_sweep.py
6.16 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
needle_code_bench.py
13.8 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
needle_serving.py
3.13 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
quant_ab.py
8.52 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
quant_accuracy.py
7.54 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
quant_inference.py
3.79 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
quant_longctx.py
6.21 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
quant_sweep.py
4.56 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
speedup_int4_kivi.py
12.2 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
sweep_decode.py
3.49 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
validate_int4_kivi_decode.py
5.68 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
validate_nvfp4_kivi.py
6.62 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
validate_paged_decode.py
4.85 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago
validate_store_equiv.py
4.12 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 1 month ago