| license: apache-2.0 | |
| base_model: | |
| - intfloat/multilingual-e5-small | |
| # quantization and input maxlength | |
| coreML: using linear quantize nbit=8 | |
| input max = 128 | |
| mlpackages for swift | |
| # note | |
| i tried turn it into float`6, but it changed too much for its prediction. quantization using linear nbit=8, it works almost like the original. | |