File size: 341 Bytes
5878c38
 
 
 
 
 
90d6de8
 
 
 
5878c38
90d6de8
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---
license: apache-2.0
base_model:
- intfloat/multilingual-e5-small
---

# quantization and input maxlength

coreML:  using linear quantize nbit=8

input max = 128

mlpackages for swift


# note

i tried turn it into float`6, but it changed too much for its prediction. quantization using linear nbit=8, it works almost like the original.