File size: 966 Bytes
07334a8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
# Text encoder validation

Validation date: 2026-07-27

Environment:

- NVIDIA GeForce RTX 4080 Laptop GPU
- ONNX 1.22.0, full model check enabled
- ONNX Runtime 1.20.1
- `DmlExecutionProvider` with CPU fallback available

The INT4 ONNX output was compared with the stored FP16 pre-quantization
reference embedding for each prompt.

| Prompt | Cosine similarity | Max absolute difference | Mean absolute difference |
|---|---:|---:|---:|
| `walk forward calmly` | 0.981569 | 2.437500 | 0.303064 |
| `walk forward confidently with long energetic strides` | 0.982333 | 2.742188 | 0.288607 |
| `sneak forward cautiously` | 0.981617 | 2.507813 | 0.271095 |
| `wave with the right hand while standing` | 0.977209 | 1.906250 | 0.318750 |
| `jog forward quickly` | 0.980100 | 2.945313 | 0.294070 |

Summary:

- minimum cosine similarity: 0.9772086
- mean cosine similarity: 0.9805653
- maximum cosine similarity: 0.9823330
- output shape: `[1, 4096]`
- all outputs finite