Sentence Similarity
Safetensors
sentence-transformers
English
PyLate
modernbert
ColBERT
multi-vector
feature-extraction
text-embeddings-inference
🇪🇺 Region: EU
Instructions to use lightonai/LateOn-hpool-regularized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use lightonai/LateOn-hpool-regularized with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="lightonai/LateOn-hpool-regularized") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False) - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -83,6 +83,8 @@ This released checkpoint uses multi-budget training with targets `[4, 8, 16, 32,
|
|
| 83 |
|
| 84 |
## Results
|
| 85 |
|
|
|
|
|
|
|
| 86 |
### Hierarchical Pooling Retention at 32 Tokens
|
| 87 |
|
| 88 |
The table below reports retention at a 32-token document budget, measured against the full-token LateOn reference.
|
|
|
|
| 83 |
|
| 84 |
## Results
|
| 85 |
|
| 86 |
+
All of the results can be found in [this space](https://huggingface.co/spaces/lightonai/hpool-regularization-results). The results are only on a subset of the 7 smaller BEIR datasets to make experiments easier and match AGC setup (SciFact, NFCorpus, ArguAna, TREC-Covid, FiQa, Touché, SciDocs). Given the original results of the hpool paper, we do not expect much different from running the whole BEIR suit.
|
| 87 |
+
|
| 88 |
### Hierarchical Pooling Retention at 32 Tokens
|
| 89 |
|
| 90 |
The table below reports retention at a 32-token document budget, measured against the full-token LateOn reference.
|