matulichpt commited on
Commit
0290339
·
verified ·
1 Parent(s): 5d8f754

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +13 -11
README.md CHANGED
@@ -32,9 +32,9 @@ model-index:
32
  - type: mrr
33
  value: 0.829
34
  name: MRR (with bi-encoder)
35
- - type: mrr_improvement
36
- value: 0.303
37
- name: MRR Improvement on ACR Core Exam (+30.3%)
38
  ---
39
 
40
  # RadLITE-Reranker
@@ -43,7 +43,7 @@ model-index:
43
 
44
  A domain-specialized cross-encoder for reranking radiology search results. This model takes a query-document pair and predicts a relevance score, providing more accurate ranking than bi-encoder similarity alone.
45
 
46
- > **Recommended:** Use this reranker together with [RadLITE-Encoder](https://huggingface.co/matulichpt/radlit-biencoder) in a two-stage pipeline for optimal performance. The bi-encoder handles fast retrieval over large corpora, then this cross-encoder reranks the top candidates for precision. This combination achieves **MRR 0.829** on radiology benchmarks (+30% on board exam questions).
47
 
48
  ## Model Description
49
 
@@ -77,14 +77,16 @@ Bi-encoders (like RadLITE-Encoder) are fast but encode query and document indepe
77
  | Bi-Encoder only | 0.78 | baseline |
78
  | **Bi-Encoder + Reranker** | **0.829** | **+6.3%** |
79
 
80
- ### ACR Core Exam (Board-Style Questions)
 
 
81
 
82
- | Dataset | With Reranker | Without | Improvement |
83
- |---------|---------------|---------|-------------|
84
- | Core Exam Chest | 0.533 | 0.409 | **+30.3%** |
85
- | Core Exam Combined | 0.466 | 0.381 | **+22.5%** |
86
 
87
- The reranker is especially valuable for complex, multi-part queries typical of board exam questions.
88
 
89
  ## Quick Start
90
 
@@ -363,7 +365,7 @@ If you use RadLITE in your work, please cite:
363
  year = {2026},
364
  month = {January},
365
  url = {https://huggingface.co/matulichpt/radlit-crossencoder},
366
- note = {+30% MRR improvement on ACR Core Exam questions}
367
  }
368
  ```
369
 
 
32
  - type: mrr
33
  value: 0.829
34
  name: MRR (with bi-encoder)
35
+ - type: mrr
36
+ value: 0.533
37
+ name: MRR on ABR Core Exam (Chest)
38
  ---
39
 
40
  # RadLITE-Reranker
 
43
 
44
  A domain-specialized cross-encoder for reranking radiology search results. This model takes a query-document pair and predicts a relevance score, providing more accurate ranking than bi-encoder similarity alone.
45
 
46
+ > **Recommended:** Use this reranker together with [RadLITE-Encoder](https://huggingface.co/matulichpt/radlit-biencoder) in a two-stage pipeline for optimal performance. The bi-encoder handles fast retrieval over large corpora, then this cross-encoder reranks the top candidates for precision. This combination achieves **MRR 0.829** on radiology retrieval benchmarks.
47
 
48
  ## Model Description
49
 
 
77
  | Bi-Encoder only | 0.78 | baseline |
78
  | **Bi-Encoder + Reranker** | **0.829** | **+6.3%** |
79
 
80
+ ### ABR Core Exam (Board-Style Questions)
81
+
82
+ Comparing two-stage pipeline (bi-encoder + reranker) vs bi-encoder alone:
83
 
84
+ | Dataset | Two-Stage MRR | Bi-Encoder Only | Improvement |
85
+ |---------|---------------|-----------------|-------------|
86
+ | Core Exam Chest | 0.533 | 0.409 | +30.3% |
87
+ | Core Exam Combined | 0.466 | 0.381 | +22.5% |
88
 
89
+ The reranker provides significant gains on complex, multi-part queries typical of board exam questions.
90
 
91
  ## Quick Start
92
 
 
365
  year = {2026},
366
  month = {January},
367
  url = {https://huggingface.co/matulichpt/radlit-crossencoder},
368
+ note = {MRR 0.829 on RadLIT-9 benchmark}
369
  }
370
  ```
371