File size: 1,578 Bytes
60a55ce c454ea5 78c3ccf f581594 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 | ---
license: apache-2.0
base_model:
- zeroentropy/zerank-1
language:
- en
pipeline_tag: text-ranking
tags:
- text-generation-inference
- legal
- stem
- code
- medical
- finance
---
# **zerank-1-GGUF**
> zerank-1 is a state-of-the-art reranker developed by ZeroEntropy to significantly enhance retrieval accuracy in search engines. Unlike most SOTA rerankers that are closed-source and proprietary, zerank-1 outperforms top models like Cohere-Rerank-v3.5 and Salesforce/LlamaRank-v1 across diverse domains including finance, legal, code, STEM, medical, and conversational data.
## Model files
| File | Size | Format |
|------|------|--------|
| zerank-1.BF16.gguf | 8.05 GB | BF16 |
| zerank-1.F16.gguf | 8.05 GB | F16 |
| zerank-1.F32.gguf | 16.1 GB | F32 |
| zerank-1.Q2_K.gguf | 1.67 GB | Q2_K |
| zerank-1.Q3_K_L.gguf | 2.24 GB | Q3_K_L |
| zerank-1.Q3_K_M.gguf | 2.08 GB | Q3_K_M |
| zerank-1.Q3_K_S.gguf | 1.89 GB | Q3_K_S |
| zerank-1.Q4_K_M.gguf | 2.5 GB | Q4_K_M |
| zerank-1.Q4_K_S.gguf | 2.38 GB | Q4_K_S |
| zerank-1.Q5_K_M.gguf | 2.89 GB | Q5_K_M |
| zerank-1.Q5_K_S.gguf | 2.82 GB | Q5_K_S |
| zerank-1.Q6_K.gguf | 3.31 GB | Q6_K |
| zerank-1.Q8_0.gguf | 4.28 GB | Q8_0 |
| .gitattributes | 2.39 kB | - |
| README.md | 462 Bytes | - |
| config.json | 29 Bytes | - |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
 |