Sentence Similarity
sentence-transformers
Safetensors
English
modernbert
colbert
late-interaction
retrieval
pylate
multi-vector
text-embeddings-inference
Instructions to use chungimungi/GLInt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use chungimungi/GLInt with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("chungimungi/GLInt") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Simplify model training-data reference
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ document tokens.
|
|
| 16 |
|
| 17 |
Training has two stages:
|
| 18 |
|
| 19 |
-
1. supervised hard-negative fine-tuning
|
| 20 |
2. mixed listwise knowledge distillation on the seven-source hard-negative mixture, with
|
| 21 |
`jinaai/jina-reranker-v3.5` scores, temperature sharpening, false-negative masking, and an
|
| 22 |
InfoNCE anchor.
|
|
@@ -54,12 +54,16 @@ computed by summing, over query tokens, the maximum similarity to a document tok
|
|
| 54 |
| [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
|
| 55 |
| **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
|
| 56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
## Training data and reproducibility
|
| 58 |
|
| 59 |
The corresponding private training artifacts are in
|
| 60 |
-
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data)
|
| 61 |
-
the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 62 |
-
contains no BEIR evaluation corpus or evaluation labels.
|
| 63 |
|
| 64 |
## Limitations
|
| 65 |
|
|
|
|
| 16 |
|
| 17 |
Training has two stages:
|
| 18 |
|
| 19 |
+
1. supervised hard-negative fine-tuning;
|
| 20 |
2. mixed listwise knowledge distillation on the seven-source hard-negative mixture, with
|
| 21 |
`jinaai/jina-reranker-v3.5` scores, temperature sharpening, false-negative masking, and an
|
| 22 |
InfoNCE anchor.
|
|
|
|
| 54 |
| [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
|
| 55 |
| **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
|
| 56 |
|
| 57 |
+
GLINT-base was evaluated with the project BEIR protocol: corpus IDs are excluded from their own
|
| 58 |
+
query results for ArguAna and Quora, and ArguAna uses 64 query tokens. The 57.43 average is one
|
| 59 |
+
run; it should not be interpreted as a seed-variance estimate.
|
| 60 |
+
|
| 61 |
## Training data and reproducibility
|
| 62 |
|
| 63 |
The corresponding private training artifacts are in
|
| 64 |
+
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
|
| 65 |
+
prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 66 |
+
shards. The repository contains no BEIR evaluation corpus or evaluation labels.
|
| 67 |
|
| 68 |
## Limitations
|
| 69 |
|