--- license: apache-2.0 language: - en - zh library_name: sentence-transformers pipeline_tag: sentence-similarity base_model: infgrad/Jasper-Token-Compression-600M tags: - sentence-transformers - feature-extraction - sentence-similarity - text-embeddings - embeddings - retrieval - mteb - qwen3 - onnx - onnxruntime - cpu - fp32 --- # Jasper Token Compression 600M — ONNX FP32 ONNX export of [infgrad/Jasper-Token-Compression-600M](https://huggingface.co/infgrad/Jasper-Token-Compression-600M). **Precision:** FP32 **Quantization:** None (FP32) **Model size:** 2.26 GiB Full-precision FP32 ONNX export. This is the reference model used for the included quantization fidelity comparisons. ## Benchmarks | Tokens | Median latency | Tokens/s | |---:|---:|---:| | 32 | 139.282 ms | 229.7 | | 128 | 155.466 ms | 823.3 | | 512 | 211.763 ms | 2,417.8 | | 1024 | 288.388 ms | 3,550.8 | ## Attribution Original model: `infgrad/Jasper-Token-Compression-600M`