Bartosz Hanc commited on
Commit ·
87137c8
1
Parent(s): 468d063
Fix config schema and explain Core ML precision
Browse files- README.md +18 -7
- base/coreml/config.json +0 -2
- base/vulkan/config.json +0 -2
- base/xnnpack/config.json +0 -2
README.md
CHANGED
|
@@ -23,16 +23,27 @@ revision `91f3fd21e131641f51e8d35736d1958350180e3a`.
|
|
| 23 |
| `base/vulkan/zipdepth_base_384_vulkan_fp16.pte` | vulkan | fp16 |
|
| 24 |
| `base/xnnpack/zipdepth_base_384_xnnpack_fp32.pte` | xnnpack | fp32 |
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
## Repository structure
|
| 27 |
|
| 28 |
```
|
| 29 |
-
config.json
|
| 30 |
-
base/coreml/config.json
|
| 31 |
-
base/coreml/zipdepth_base_384_coreml_fp32.pte
|
| 32 |
-
base/vulkan/config.json
|
| 33 |
-
base/vulkan/zipdepth_base_384_vulkan_fp16.pte
|
| 34 |
-
base/xnnpack/config.json
|
| 35 |
-
base/xnnpack/zipdepth_base_384_xnnpack_fp32.pte
|
| 36 |
```
|
| 37 |
|
| 38 |
## Compatibility
|
|
|
|
| 23 |
| `base/vulkan/zipdepth_base_384_vulkan_fp16.pte` | vulkan | fp16 |
|
| 24 |
| `base/xnnpack/zipdepth_base_384_xnnpack_fp32.pte` | xnnpack | fp32 |
|
| 25 |
|
| 26 |
+
## Core ML precision
|
| 27 |
+
|
| 28 |
+
The Core ML export uses FP32 because FP16 reduced numerical agreement with the
|
| 29 |
+
float reference: across seven photos/illustrations, its worst range-normalized
|
| 30 |
+
RMSE was 6.31% and minimum correlation was 0.970. FP32 reduced the worst
|
| 31 |
+
range-normalized RMSE to below 0.00012%.
|
| 32 |
+
|
| 33 |
+
Unlike the FP16 Core ML exports, this FP32 ML program runs on CPU/GPU and cannot
|
| 34 |
+
use the Apple Neural Engine, even with compute units set to `ALL`; see
|
| 35 |
+
[Apple's typed-execution guide](https://apple.github.io/coremltools/docs-guides/source/typed-execution.html).
|
| 36 |
+
|
| 37 |
## Repository structure
|
| 38 |
|
| 39 |
```
|
| 40 |
+
config.json 30 B
|
| 41 |
+
base/coreml/config.json 847 B
|
| 42 |
+
base/coreml/zipdepth_base_384_coreml_fp32.pte 24.9 MB
|
| 43 |
+
base/vulkan/config.json 847 B
|
| 44 |
+
base/vulkan/zipdepth_base_384_vulkan_fp16.pte 12.8 MB
|
| 45 |
+
base/xnnpack/config.json 849 B
|
| 46 |
+
base/xnnpack/zipdepth_base_384_xnnpack_fp32.pte 24.6 MB
|
| 47 |
```
|
| 48 |
|
| 49 |
## Compatibility
|
base/coreml/config.json
CHANGED
|
@@ -11,8 +11,6 @@
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_coreml_fp32.pte",
|
| 13 |
"precision": "fp32",
|
| 14 |
-
"quantized": false,
|
| 15 |
-
"default": true,
|
| 16 |
"methods": {
|
| 17 |
"forward": {
|
| 18 |
"inputs": [
|
|
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_coreml_fp32.pte",
|
| 13 |
"precision": "fp32",
|
|
|
|
|
|
|
| 14 |
"methods": {
|
| 15 |
"forward": {
|
| 16 |
"inputs": [
|
base/vulkan/config.json
CHANGED
|
@@ -11,8 +11,6 @@
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_vulkan_fp16.pte",
|
| 13 |
"precision": "fp16",
|
| 14 |
-
"quantized": false,
|
| 15 |
-
"default": true,
|
| 16 |
"methods": {
|
| 17 |
"forward": {
|
| 18 |
"inputs": [
|
|
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_vulkan_fp16.pte",
|
| 13 |
"precision": "fp16",
|
|
|
|
|
|
|
| 14 |
"methods": {
|
| 15 |
"forward": {
|
| 16 |
"inputs": [
|
base/xnnpack/config.json
CHANGED
|
@@ -11,8 +11,6 @@
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_xnnpack_fp32.pte",
|
| 13 |
"precision": "fp32",
|
| 14 |
-
"quantized": false,
|
| 15 |
-
"default": true,
|
| 16 |
"methods": {
|
| 17 |
"forward": {
|
| 18 |
"inputs": [
|
|
|
|
| 11 |
{
|
| 12 |
"file": "zipdepth_base_384_xnnpack_fp32.pte",
|
| 13 |
"precision": "fp32",
|
|
|
|
|
|
|
| 14 |
"methods": {
|
| 15 |
"forward": {
|
| 16 |
"inputs": [
|