kv-landlords / vllm /tests /quantization

206 kB

Ctrl+K

1 contributor

History: 1 commit

a1exxd0

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified about 2 months ago

__init__.py

0 Bytes
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
fp_quant.py

974 Bytes
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
reference_mxfp4.py

8.79 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_auto_gptq.py

1.7 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_auto_round.py

997 Bytes
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_blackwell_moe.py

8.57 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_compressed_tensors.py

25.5 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_configs.py

2.49 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_cpu_offload.py

2.37 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_cpu_wna16.py

1.03 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_cutlass_w4a16.py

6.33 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_experts_int8.py

1.15 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_fp8.py

18.3 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_gfx950_moe.py

3.09 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_gptq_dynamic.py

3.21 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_gptq_v2.py

3.95 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_lm_head.py

1.61 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_mixed_precision.py

2.11 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_modelopt.py

19.8 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_online.py

5.91 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_per_token_kv_cache.py

19.6 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_quantization_config_args.py

5.25 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_quark.py

14 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_register_quantization_config.py

4.82 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_torchao.py

14.4 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_trtllm_nvfp4_hidden_dim_padding.py

2.47 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
test_turboquant.py

24.2 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
utils.py

3.62 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago