Sentence Similarity
sentence-transformers
Safetensors
English
modernbert
colbert
late-interaction
retrieval
pylate
multi-vector
text-embeddings-inference
Instructions to use chungimungi/GLInt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use chungimungi/GLInt with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("chungimungi/GLInt") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,12 +20,26 @@ GLINT-base is a 149M-parameter English late-interaction retriever built from
|
|
| 20 |
128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
|
| 21 |
document tokens.
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
## Usage
|
| 31 |
|
|
@@ -63,4 +77,4 @@ computed by summing, over query tokens, the maximum similarity to a document tok
|
|
| 63 |
The corresponding private training artifacts are in
|
| 64 |
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
|
| 65 |
prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 66 |
-
shards. The repository contains no BEIR evaluation corpus or evaluation labels.
|
|
|
|
| 20 |
128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
|
| 21 |
document tokens.
|
| 22 |
|
| 23 |
+
## What is new in GLINT?
|
| 24 |
|
| 25 |
+
GLINT is designed around the mismatch between ordinary dense hard-negative mining and a
|
| 26 |
+
late-interaction retriever. Dense mining selects documents that are difficult under one pooled
|
| 27 |
+
vector; GLINT instead mines negatives under the same token-level MaxSim geometry used at
|
| 28 |
+
retrieval time. This exposes lexical, compositional, and localized token matches that a
|
| 29 |
+
single-vector miner can miss.
|
| 30 |
+
|
| 31 |
+
The training recipe has two stages:
|
| 32 |
+
|
| 33 |
+
1. supervised fine-tuning with multi-vector (MaxSim) hard negatives;
|
| 34 |
+
2. mixed listwise knowledge distillation over a diverse seven-source hard-negative mixture.
|
| 35 |
+
|
| 36 |
+
For the second stage, a frozen listwise teacher (`jinaai/jina-reranker-v3.5`) scores each
|
| 37 |
+
32-document candidate set jointly. GLINT distils that ordering with a sharpened listwise KL
|
| 38 |
+
objective, while a false-negative-masked InfoNCE term preserves a direct retrieval signal.
|
| 39 |
+
The result is still one compact, first-stage late-interaction retriever: it is neither an
|
| 40 |
+
ensemble nor a re-ranker at inference time.
|
| 41 |
+
|
| 42 |
+
This is a private research release.
|
| 43 |
|
| 44 |
## Usage
|
| 45 |
|
|
|
|
| 77 |
The corresponding private training artifacts are in
|
| 78 |
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
|
| 79 |
prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 80 |
+
shards. The repository contains no BEIR evaluation corpus or evaluation labels.
|