chungimungi commited on
Commit
b7408db
·
verified ·
1 Parent(s): 1d1867f

Simplify model training-data reference

Browse files
Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -16,7 +16,7 @@ document tokens.
16
 
17
  Training has two stages:
18
 
19
- 1. supervised hard-negative fine-tuning using the BiCA-prepared training set;
20
  2. mixed listwise knowledge distillation on the seven-source hard-negative mixture, with
21
  `jinaai/jina-reranker-v3.5` scores, temperature sharpening, false-negative masking, and an
22
  InfoNCE anchor.
@@ -54,12 +54,16 @@ computed by summing, over query tokens, the maximum similarity to a document tok
54
  | [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
55
  | **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
56
 
 
 
 
 
57
  ## Training data and reproducibility
58
 
59
  The corresponding private training artifacts are in
60
- [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data): the prepared BiCA SFT rows,
61
- the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet shards. The repository
62
- contains no BEIR evaluation corpus or evaluation labels.
63
 
64
  ## Limitations
65
 
 
16
 
17
  Training has two stages:
18
 
19
+ 1. supervised hard-negative fine-tuning;
20
  2. mixed listwise knowledge distillation on the seven-source hard-negative mixture, with
21
  `jinaai/jina-reranker-v3.5` scores, temperature sharpening, false-negative masking, and an
22
  InfoNCE anchor.
 
54
  | [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
55
  | **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
56
 
57
+ GLINT-base was evaluated with the project BEIR protocol: corpus IDs are excluded from their own
58
+ query results for ArguAna and Quora, and ArguAna uses 64 query tokens. The 57.43 average is one
59
+ run; it should not be interpreted as a seed-variance estimate.
60
+
61
  ## Training data and reproducibility
62
 
63
  The corresponding private training artifacts are in
64
+ [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
65
+ prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
66
+ shards. The repository contains no BEIR evaluation corpus or evaluation labels.
67
 
68
  ## Limitations
69