Instructions to use litert-community/MobileNet-v3-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/MobileNet-v3-small with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Replace the dynamic int8 file with a weight-only int8 file
#2
by mlboydaisuke - opened
README.md
CHANGED
|
@@ -51,10 +51,20 @@ The license information of the original model was missing.
|
|
| 51 |
| File | Description |
|
| 52 |
| --- | --- |
|
| 53 |
| `mobilenet_v3_small.tflite` | Full precision LiteRT/TFLite model. |
|
| 54 |
-
| `
|
| 55 |
| `mobilenet_v3_small_Google_Tensor_G5_apply_plugin.tflite` | AOT-compiled artifact for the Google Tensor G5 target. |
|
| 56 |
| `mobilenet_v3_small_int8_channelwise.tflite` | Static INT8 model with channelwise INT8 weights and asymmetric INT8 activations. |
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
## Quantization
|
| 59 |
|
| 60 |
`mobilenet_v3_small_int8_channelwise.tflite` was produced with the `STATIC_WI8_AI8` quantization recipe. Weights are signed INT8 and use symmetric channelwise quantization for weight tensors. Activations are signed INT8 with asymmetric quantization parameters.
|
|
|
|
| 51 |
| File | Description |
|
| 52 |
| --- | --- |
|
| 53 |
| `mobilenet_v3_small.tflite` | Full precision LiteRT/TFLite model. |
|
| 54 |
+
| `mobilenet_v3_small_weight_only_wi8_afp32.tflite` | Weight-only INT8 model with FP32 activations. |
|
| 55 |
| `mobilenet_v3_small_Google_Tensor_G5_apply_plugin.tflite` | AOT-compiled artifact for the Google Tensor G5 target. |
|
| 56 |
| `mobilenet_v3_small_int8_channelwise.tflite` | Static INT8 model with channelwise INT8 weights and asymmetric INT8 activations. |
|
| 57 |
|
| 58 |
+
### Quantized variant
|
| 59 |
+
|
| 60 |
+
`mobilenet_v3_small_weight_only_wi8_afp32.tflite` is a weight-only int8
|
| 61 |
+
quantization of the same weights (about 3.7x smaller than float32).
|
| 62 |
+
Weight-only quantization is used instead of dynamic-range quantization
|
| 63 |
+
because MobileNetV3's SE and hard-swish layers are sensitive to activation
|
| 64 |
+
quantization; in a spot check against the float model the weight-only
|
| 65 |
+
file keeps the top-1 predictions on real photos with a minimum logit
|
| 66 |
+
correlation of 0.991.
|
| 67 |
+
|
| 68 |
## Quantization
|
| 69 |
|
| 70 |
`mobilenet_v3_small_int8_channelwise.tflite` was produced with the `STATIC_WI8_AI8` quantization recipe. Weights are signed INT8 and use symmetric channelwise quantization for weight tensors. Activations are signed INT8 with asymmetric quantization parameters.
|
mobilenet_v3_small_dynamic_wi8_afp32.tflite β mobilenet_v3_small_weight_only_wi8_afp32.tflite
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:04f7ee3ab9a50dc7c828f82d040712ab0b85f0d54c13258b885482038005b5a8
|
| 3 |
+
size 2746704
|