Sentence Similarity
sentence-transformers
ONNX
English
Chinese
qwen3
feature-extraction
text-embeddings
embeddings
retrieval
mteb
onnxruntime
cpu
int-8
custom_code
text-embeddings-inference
Instructions to use magiccodingman/Jasper-Token-Compression-600M-ONNX-INT8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use magiccodingman/Jasper-Token-Compression-600M-ONNX-INT8 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("magiccodingman/Jasper-Token-Compression-600M-ONNX-INT8", trust_remote_code=True) sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
| import torch | |
| from sentence_transformers.models import Transformer as BaseTransformer | |
| class JasperTransformer(BaseTransformer): | |
| def forward(self, features: dict[str, torch.Tensor], **kwargs) -> dict[str, torch.Tensor]: | |
| vectors = self.auto_model(**features, **kwargs) | |
| features.update({"sentence_embedding": vectors}) | |
| return features | |