chungimungi commited on
Commit
bf0b062
·
verified ·
1 Parent(s): aebf33a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -10
README.md CHANGED
@@ -61,18 +61,9 @@ computed by summing, over query tokens, the maximum similarity to a document tok
61
  | [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | 92.02 | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | 89.67 | **21.90** | 76.61 | 83.60 | 30.52 |
62
  | GLINT-base | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | **47.68** | **92.45** | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
63
 
64
- GLINT-base was evaluated with the project BEIR protocol: corpus IDs are excluded from their own
65
- query results for ArguAna and Quora, and ArguAna uses 64 query tokens. The 57.43 average is one
66
- run; it should not be interpreted as a seed-variance estimate.
67
-
68
  ## Training data and reproducibility
69
 
70
  The corresponding private training artifacts are in
71
  [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
72
  prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
73
- shards. The repository contains no BEIR evaluation corpus or evaluation labels.
74
-
75
- ## Limitations
76
-
77
- This is an English retrieval model. It is intended for research and offline evaluation; assess
78
- domain fit, bias, and source-data licensing before using it in a production search system.
 
61
  | [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | 92.02 | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | 89.67 | **21.90** | 76.61 | 83.60 | 30.52 |
62
  | GLINT-base | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | **47.68** | **92.45** | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
63
 
 
 
 
 
64
  ## Training data and reproducibility
65
 
66
  The corresponding private training artifacts are in
67
  [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
68
  prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
69
+ shards. The repository contains no BEIR evaluation corpus or evaluation labels.