Feature Extraction
sentence-transformers
Safetensors
English
bert
sparse-encoder
sparse
splade
Generated from Trainer
dataset_size:1200000
loss:SpladeLoss
loss:SparseMarginMSELoss
loss:FlopsLoss
Eval Results (legacy)
text-embeddings-inference
Instructions to use rasyosef/splade-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use rasyosef/splade-tiny with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("rasyosef/splade-tiny") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -154,9 +154,9 @@ This is a SPLADE sparse retrieval model based on BERT-Tiny (4M) that was trained
|
|
| 154 |
|
| 155 |
This tiny SPLADE model is `15x` smaller than Naver's official `splade-v3-distilbert` while having `80%` of it's performance on the MSMARCO benchmark. This model is small enough to be used without a GPU on a dataset of a few thousand documents.
|
| 156 |
|
| 157 |
-
- Collection: https://huggingface.co/collections/rasyosef/splade-tiny-msmarco-687c548c0691d95babf65b70
|
| 158 |
-
- Distillation Dataset: https://huggingface.co/datasets/yosefw/msmarco-train-distil-v2
|
| 159 |
-
- Code: https://github.com/rasyosef/splade-tiny-msmarco
|
| 160 |
|
| 161 |
## Performance
|
| 162 |
|
|
|
|
| 154 |
|
| 155 |
This tiny SPLADE model is `15x` smaller than Naver's official `splade-v3-distilbert` while having `80%` of it's performance on the MSMARCO benchmark. This model is small enough to be used without a GPU on a dataset of a few thousand documents.
|
| 156 |
|
| 157 |
+
- `Collection:` https://huggingface.co/collections/rasyosef/splade-tiny-msmarco-687c548c0691d95babf65b70
|
| 158 |
+
- `Distillation Dataset:` https://huggingface.co/datasets/yosefw/msmarco-train-distil-v2
|
| 159 |
+
- `Code:` https://github.com/rasyosef/splade-tiny-msmarco
|
| 160 |
|
| 161 |
## Performance
|
| 162 |
|