Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -32,9 +32,9 @@ model-index:
|
|
| 32 |
- type: mrr
|
| 33 |
value: 0.829
|
| 34 |
name: MRR (with bi-encoder)
|
| 35 |
-
- type:
|
| 36 |
-
value: 0.
|
| 37 |
-
name: MRR
|
| 38 |
---
|
| 39 |
|
| 40 |
# RadLITE-Reranker
|
|
@@ -43,7 +43,7 @@ model-index:
|
|
| 43 |
|
| 44 |
A domain-specialized cross-encoder for reranking radiology search results. This model takes a query-document pair and predicts a relevance score, providing more accurate ranking than bi-encoder similarity alone.
|
| 45 |
|
| 46 |
-
> **Recommended:** Use this reranker together with [RadLITE-Encoder](https://huggingface.co/matulichpt/radlit-biencoder) in a two-stage pipeline for optimal performance. The bi-encoder handles fast retrieval over large corpora, then this cross-encoder reranks the top candidates for precision. This combination achieves **MRR 0.829** on radiology benchmarks
|
| 47 |
|
| 48 |
## Model Description
|
| 49 |
|
|
@@ -77,14 +77,16 @@ Bi-encoders (like RadLITE-Encoder) are fast but encode query and document indepe
|
|
| 77 |
| Bi-Encoder only | 0.78 | baseline |
|
| 78 |
| **Bi-Encoder + Reranker** | **0.829** | **+6.3%** |
|
| 79 |
|
| 80 |
-
###
|
|
|
|
|
|
|
| 81 |
|
| 82 |
-
| Dataset |
|
| 83 |
-
|
| 84 |
-
| Core Exam Chest | 0.533 | 0.409 |
|
| 85 |
-
| Core Exam Combined | 0.466 | 0.381 |
|
| 86 |
|
| 87 |
-
The reranker
|
| 88 |
|
| 89 |
## Quick Start
|
| 90 |
|
|
@@ -363,7 +365,7 @@ If you use RadLITE in your work, please cite:
|
|
| 363 |
year = {2026},
|
| 364 |
month = {January},
|
| 365 |
url = {https://huggingface.co/matulichpt/radlit-crossencoder},
|
| 366 |
-
note = {
|
| 367 |
}
|
| 368 |
```
|
| 369 |
|
|
|
|
| 32 |
- type: mrr
|
| 33 |
value: 0.829
|
| 34 |
name: MRR (with bi-encoder)
|
| 35 |
+
- type: mrr
|
| 36 |
+
value: 0.533
|
| 37 |
+
name: MRR on ABR Core Exam (Chest)
|
| 38 |
---
|
| 39 |
|
| 40 |
# RadLITE-Reranker
|
|
|
|
| 43 |
|
| 44 |
A domain-specialized cross-encoder for reranking radiology search results. This model takes a query-document pair and predicts a relevance score, providing more accurate ranking than bi-encoder similarity alone.
|
| 45 |
|
| 46 |
+
> **Recommended:** Use this reranker together with [RadLITE-Encoder](https://huggingface.co/matulichpt/radlit-biencoder) in a two-stage pipeline for optimal performance. The bi-encoder handles fast retrieval over large corpora, then this cross-encoder reranks the top candidates for precision. This combination achieves **MRR 0.829** on radiology retrieval benchmarks.
|
| 47 |
|
| 48 |
## Model Description
|
| 49 |
|
|
|
|
| 77 |
| Bi-Encoder only | 0.78 | baseline |
|
| 78 |
| **Bi-Encoder + Reranker** | **0.829** | **+6.3%** |
|
| 79 |
|
| 80 |
+
### ABR Core Exam (Board-Style Questions)
|
| 81 |
+
|
| 82 |
+
Comparing two-stage pipeline (bi-encoder + reranker) vs bi-encoder alone:
|
| 83 |
|
| 84 |
+
| Dataset | Two-Stage MRR | Bi-Encoder Only | Improvement |
|
| 85 |
+
|---------|---------------|-----------------|-------------|
|
| 86 |
+
| Core Exam Chest | 0.533 | 0.409 | +30.3% |
|
| 87 |
+
| Core Exam Combined | 0.466 | 0.381 | +22.5% |
|
| 88 |
|
| 89 |
+
The reranker provides significant gains on complex, multi-part queries typical of board exam questions.
|
| 90 |
|
| 91 |
## Quick Start
|
| 92 |
|
|
|
|
| 365 |
year = {2026},
|
| 366 |
month = {January},
|
| 367 |
url = {https://huggingface.co/matulichpt/radlit-crossencoder},
|
| 368 |
+
note = {MRR 0.829 on RadLIT-9 benchmark}
|
| 369 |
}
|
| 370 |
```
|
| 371 |
|