Replace the dynamic int8 file with a weight-only int8 file

#2
by mlboydaisuke - opened
README.md CHANGED
@@ -51,10 +51,20 @@ The license information of the original model was missing.
51
  | File | Description |
52
  | --- | --- |
53
  | `mobilenet_v3_small.tflite` | Full precision LiteRT/TFLite model. |
54
- | `mobilenet_v3_small_dynamic_wi8_afp32.tflite` | Dynamic weight-only INT8 model with FP32 activations. |
55
  | `mobilenet_v3_small_Google_Tensor_G5_apply_plugin.tflite` | AOT-compiled artifact for the Google Tensor G5 target. |
56
  | `mobilenet_v3_small_int8_channelwise.tflite` | Static INT8 model with channelwise INT8 weights and asymmetric INT8 activations. |
57
 
 
 
 
 
 
 
 
 
 
 
58
  ## Quantization
59
 
60
  `mobilenet_v3_small_int8_channelwise.tflite` was produced with the `STATIC_WI8_AI8` quantization recipe. Weights are signed INT8 and use symmetric channelwise quantization for weight tensors. Activations are signed INT8 with asymmetric quantization parameters.
 
51
  | File | Description |
52
  | --- | --- |
53
  | `mobilenet_v3_small.tflite` | Full precision LiteRT/TFLite model. |
54
+ | `mobilenet_v3_small_weight_only_wi8_afp32.tflite` | Weight-only INT8 model with FP32 activations. |
55
  | `mobilenet_v3_small_Google_Tensor_G5_apply_plugin.tflite` | AOT-compiled artifact for the Google Tensor G5 target. |
56
  | `mobilenet_v3_small_int8_channelwise.tflite` | Static INT8 model with channelwise INT8 weights and asymmetric INT8 activations. |
57
 
58
+ ### Quantized variant
59
+
60
+ `mobilenet_v3_small_weight_only_wi8_afp32.tflite` is a weight-only int8
61
+ quantization of the same weights (about 3.7x smaller than float32).
62
+ Weight-only quantization is used instead of dynamic-range quantization
63
+ because MobileNetV3's SE and hard-swish layers are sensitive to activation
64
+ quantization; in a spot check against the float model the weight-only
65
+ file keeps the top-1 predictions on real photos with a minimum logit
66
+ correlation of 0.991.
67
+
68
  ## Quantization
69
 
70
  `mobilenet_v3_small_int8_channelwise.tflite` was produced with the `STATIC_WI8_AI8` quantization recipe. Weights are signed INT8 and use symmetric channelwise quantization for weight tensors. Activations are signed INT8 with asymmetric quantization parameters.
mobilenet_v3_small_dynamic_wi8_afp32.tflite β†’ mobilenet_v3_small_weight_only_wi8_afp32.tflite RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a93f73c57e09b1f0224ee9965ae92af6c7da16373b2b02f9db232721f5b0ced6
3
- size 2741424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04f7ee3ab9a50dc7c828f82d040712ab0b85f0d54c13258b885482038005b5a8
3
+ size 2746704