Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ pipeline_tag: text-ranking
|
|
| 8 |
|
| 9 |
## Highlights
|
| 10 |
|
| 11 |
-
Our reranker is on the Pareto frontier across 5 key areas:
|
| 12 |
- Instruction following (including capability to rank more recent information higher)
|
| 13 |
- Question answering
|
| 14 |
- Multilinguality
|
|
@@ -26,14 +26,14 @@ For more details on these and other benchmarks, please refer to our [blogpost](h
|
|
| 26 |
- Model Type: Text Reranking
|
| 27 |
- Supported Languages: 100+
|
| 28 |
- Number of Paramaters: 1B
|
| 29 |
-
- Context Length:
|
| 30 |
- Blogpost: https://contextual.ai/blog/rerank-v2
|
| 31 |
|
| 32 |
## Quickstart
|
| 33 |
|
| 34 |
### vLLM usage
|
| 35 |
|
| 36 |
-
Requires vllm
|
| 37 |
|
| 38 |
```python
|
| 39 |
import os
|
|
@@ -102,7 +102,7 @@ def infer_w_vllm(model_path: str, query: str, instruction: str, documents: list[
|
|
| 102 |
|
| 103 |
### Transformers Usage
|
| 104 |
|
| 105 |
-
Requires transformers>=4.51.0 for
|
| 106 |
|
| 107 |
```python
|
| 108 |
import torch
|
|
@@ -174,7 +174,7 @@ If you use this model, please cite:
|
|
| 174 |
|
| 175 |
## License
|
| 176 |
|
| 177 |
-
Creative Commons Attribution Non Commercial Share Alike 4.0
|
| 178 |
|
| 179 |
## Contact
|
| 180 |
|
|
|
|
| 8 |
|
| 9 |
## Highlights
|
| 10 |
|
| 11 |
+
Our reranker is on the cost/performance Pareto frontier across 5 key areas:
|
| 12 |
- Instruction following (including capability to rank more recent information higher)
|
| 13 |
- Question answering
|
| 14 |
- Multilinguality
|
|
|
|
| 26 |
- Model Type: Text Reranking
|
| 27 |
- Supported Languages: 100+
|
| 28 |
- Number of Paramaters: 1B
|
| 29 |
+
- Context Length: up to 32K
|
| 30 |
- Blogpost: https://contextual.ai/blog/rerank-v2
|
| 31 |
|
| 32 |
## Quickstart
|
| 33 |
|
| 34 |
### vLLM usage
|
| 35 |
|
| 36 |
+
Requires vllm==0.10.0 for NVFP4 or vllm>=0.8.5 for BF16.
|
| 37 |
|
| 38 |
```python
|
| 39 |
import os
|
|
|
|
| 102 |
|
| 103 |
### Transformers Usage
|
| 104 |
|
| 105 |
+
Requires transformers>=4.51.0 for BF16. Not supported for NVFP4.
|
| 106 |
|
| 107 |
```python
|
| 108 |
import torch
|
|
|
|
| 174 |
|
| 175 |
## License
|
| 176 |
|
| 177 |
+
Creative Commons Attribution Non Commercial Share Alike 4.0 (cc-by-nc-sa-4.0)
|
| 178 |
|
| 179 |
## Contact
|
| 180 |
|