poolside-laguna-hackathon
/

kv-landlords

Model card Files Files and versions

kv-landlords / vllm /tests /model_executor /layers

30.4 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

a1exxd0's picture

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified 2 months ago

test_pooler_activations.py

8.33 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 2 months ago
test_pooler_methods.py

18.3 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 2 months ago
test_rocm_unquantized_gemm.py

3.81 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source 2 months ago