67.3 kB

Ctrl+K

1 contributor

History: 1 commit

a1exxd0

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified about 2 months ago

template
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
cohere_rerank_client.py

1.37 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
colbert_rerank_online.py

2.67 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
colmodernvbert_rerank_online.py

5.15 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
colqwen3_5_rerank_online.py

3.8 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
colqwen3_rerank_online.py

8.16 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
convert_model_to_seq_cls.py

7.45 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
qwen3_reranker_offline.py

4.01 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
qwen3_reranker_online.py

3.11 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
rerank_api_online.py

1.06 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
score_api_online.py

2.35 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
using_template_offline.py

6.71 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
using_template_online.py

3.96 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
vision_rerank_api_online.py

4.03 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
vision_reranker_offline.py

6.12 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago
vision_score_api_online.py

4.37 kB
Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source about 2 months ago