| --- |
| license: apache-2.0 |
| language: |
| - en |
| - zh |
| library_name: sentence-transformers |
| pipeline_tag: sentence-similarity |
| base_model: infgrad/Jasper-Token-Compression-600M |
| tags: |
| - sentence-transformers |
| - feature-extraction |
| - sentence-similarity |
| - text-embeddings |
| - embeddings |
| - retrieval |
| - mteb |
| - qwen3 |
| - onnx |
| - onnxruntime |
| - cpu |
| - fp32 |
| --- |
| |
| # Jasper Token Compression 600M — ONNX FP32 |
|
|
| ONNX export of [infgrad/Jasper-Token-Compression-600M](https://huggingface.co/infgrad/Jasper-Token-Compression-600M). |
|
|
| **Precision:** FP32 |
| **Quantization:** None (FP32) |
| **Model size:** 2.26 GiB |
|
|
| Full-precision FP32 ONNX export. This is the reference model used for the included quantization fidelity comparisons. |
|
|
| ## Benchmarks |
|
|
| | Tokens | Median latency | Tokens/s | |
| |---:|---:|---:| |
| | 32 | 139.282 ms | 229.7 | |
| | 128 | 155.466 ms | 823.3 | |
| | 512 | 211.763 ms | 2,417.8 | |
| | 1024 | 288.388 ms | 3,550.8 | |
|
|
| ## Attribution |
|
|
| Original model: `infgrad/Jasper-Token-Compression-600M` |
|
|
