chungimungi commited on
Commit
e582b00
·
verified ·
1 Parent(s): a043934

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -6
README.md CHANGED
@@ -20,12 +20,26 @@ GLINT-base is a 149M-parameter English late-interaction retriever built from
20
  128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
21
  document tokens.
22
 
23
- Training has two stages:
24
 
25
- 1. supervised hard-negative fine-tuning;
26
- 2. mixed listwise knowledge distillation on the seven-source hard-negative mixture, with
27
- `jinaai/jina-reranker-v3.5` scores, temperature sharpening, false-negative masking, and an
28
- InfoNCE anchor.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
  ## Usage
31
 
@@ -63,4 +77,4 @@ computed by summing, over query tokens, the maximum similarity to a document tok
63
  The corresponding private training artifacts are in
64
  [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
65
  prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
66
- shards. The repository contains no BEIR evaluation corpus or evaluation labels.
 
20
  128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
21
  document tokens.
22
 
23
+ ## What is new in GLINT?
24
 
25
+ GLINT is designed around the mismatch between ordinary dense hard-negative mining and a
26
+ late-interaction retriever. Dense mining selects documents that are difficult under one pooled
27
+ vector; GLINT instead mines negatives under the same token-level MaxSim geometry used at
28
+ retrieval time. This exposes lexical, compositional, and localized token matches that a
29
+ single-vector miner can miss.
30
+
31
+ The training recipe has two stages:
32
+
33
+ 1. supervised fine-tuning with multi-vector (MaxSim) hard negatives;
34
+ 2. mixed listwise knowledge distillation over a diverse seven-source hard-negative mixture.
35
+
36
+ For the second stage, a frozen listwise teacher (`jinaai/jina-reranker-v3.5`) scores each
37
+ 32-document candidate set jointly. GLINT distils that ordering with a sharpened listwise KL
38
+ objective, while a false-negative-masked InfoNCE term preserves a direct retrieval signal.
39
+ The result is still one compact, first-stage late-interaction retriever: it is neither an
40
+ ensemble nor a re-ranker at inference time.
41
+
42
+ This is a private research release.
43
 
44
  ## Usage
45
 
 
77
  The corresponding private training artifacts are in
78
  [GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
79
  prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
80
+ shards. The repository contains no BEIR evaluation corpus or evaluation labels.