prithivMLmods
/

Qwen3-Reranker-0.6B-seq-cls-GGUF

text-generation-inference

Model card Files Files and versions

Qwen3-Reranker-0.6B-seq-cls-GGUF

8.91 GB

1 contributor

History: 7 commits

prithivMLmods's picture

Upload folder using huggingface_hub

0f47cbd verified 7 months ago

.gitattributes
2.49 kB

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.BF16.gguf
1.2 GB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.F16.gguf
1.2 GB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.F32.gguf
2.39 GB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q2_K.gguf
296 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q3_K_L.gguf
368 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q3_K_M.gguf
347 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q3_K_S.gguf
323 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q4_K_M.gguf
396 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q4_K_S.gguf
383 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q5_K_M.gguf
444 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q5_K_S.gguf
436 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q6_K.gguf
495 MB
xet

Upload folder using huggingface_hub 7 months ago
Qwen3-Reranker-0.6B-seq-cls.Q8_0.gguf
639 MB
xet

Upload folder using huggingface_hub 7 months ago
README.md
2.06 kB

Update README.md 7 months ago
config.json
27 Bytes

Upload folder using huggingface_hub 7 months ago