File size: 963 Bytes
2eaa5f6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 | ---
license: apache-2.0
language:
- en
- zh
library_name: sentence-transformers
pipeline_tag: sentence-similarity
base_model: infgrad/Jasper-Token-Compression-600M
tags:
- sentence-transformers
- feature-extraction
- sentence-similarity
- text-embeddings
- embeddings
- retrieval
- mteb
- qwen3
- onnx
- onnxruntime
- cpu
- fp32
---
# Jasper Token Compression 600M — ONNX FP32
ONNX export of [infgrad/Jasper-Token-Compression-600M](https://huggingface.co/infgrad/Jasper-Token-Compression-600M).
**Precision:** FP32
**Quantization:** None (FP32)
**Model size:** 2.26 GiB
Full-precision FP32 ONNX export. This is the reference model used for the included quantization fidelity comparisons.
## Benchmarks
| Tokens | Median latency | Tokens/s |
|---:|---:|---:|
| 32 | 139.282 ms | 229.7 |
| 128 | 155.466 ms | 823.3 |
| 512 | 211.763 ms | 2,417.8 |
| 1024 | 288.388 ms | 3,550.8 |
## Attribution
Original model: `infgrad/Jasper-Token-Compression-600M`
|