kv-landlords / scripts

155 kB

Ctrl+K

1 contributor

History: 1 commit

a1exxd0

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified 3 months ago

bench_int4_kivi.py

5.77 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
bench_paged_decode.py

3.82 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
bench_quant_vs_flash.py

4.74 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
ceiling_and_mem.py

6.33 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
decode_latency_serving.py

4.26 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
diag_kernel_perchannel.py

4.54 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
humaneval_bench.py

9.78 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
int4_kivi_generate.py

7.16 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
longctx_code_bench.py

11.5 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
longctx_code_serving.py

6.48 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
longctx_sweep.py

6.16 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
needle_code_bench.py

13.8 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
needle_serving.py

3.13 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
quant_ab.py

8.52 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
quant_accuracy.py

7.54 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
quant_inference.py

3.79 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
quant_longctx.py

6.21 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
quant_sweep.py

4.56 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
speedup_int4_kivi.py

12.2 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
sweep_decode.py

3.49 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
validate_int4_kivi_decode.py

5.68 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
validate_nvfp4_kivi.py

6.62 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
validate_paged_decode.py

4.85 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago
validate_store_equiv.py

4.12 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 3 months ago