chua commited on
Commit
b736f8d
·
verified ·
1 Parent(s): 5708c7d

Update model card footprint and quantization notes

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -40,6 +40,7 @@ locally; no network request is required by the SDK or demo app.
40
  | `dist/ASRModels.bundle` | Prebuilt model assets: Core ML audio tower, ONNX decoder, tokenizer tables, and integrity manifest |
41
  | `ASRDemo/` | Minimal iOS app for microphone recording and one-shot transcription |
42
  | `ANEBench/` | Optional iOS app for Core ML / ANE latency and sustained-load checks |
 
43
  | `GETTING_STARTED.md` | Reproducible setup, build, signing, and device-testing guide |
44
  | `LICENSE` | Apache License 2.0 |
45
 
@@ -48,6 +49,27 @@ locally; no network request is required by the SDK or demo app.
48
  - [Audio8-ASR-0.1B](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B): base model checkpoint.
49
  - [Audio8-ASR-0.1B-onnx-runtime](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B-onnx-runtime): ONNX Runtime package.
50
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  ## Quick Start
52
 
53
  ```bash
 
40
  | `dist/ASRModels.bundle` | Prebuilt model assets: Core ML audio tower, ONNX decoder, tokenizer tables, and integrity manifest |
41
  | `ASRDemo/` | Minimal iOS app for microphone recording and one-shot transcription |
42
  | `ANEBench/` | Optional iOS app for Core ML / ANE latency and sustained-load checks |
43
+ | `assets/` | Screenshots and model-card media |
44
  | `GETTING_STARTED.md` | Reproducible setup, build, signing, and device-testing guide |
45
  | `LICENSE` | Apache License 2.0 |
46
 
 
49
  - [Audio8-ASR-0.1B](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B): base model checkpoint.
50
  - [Audio8-ASR-0.1B-onnx-runtime](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B-onnx-runtime): ONNX Runtime package.
51
 
52
+ ## Packaged Model Variant and Footprint
53
+
54
+ This release packages the iPhone ANE-oriented variant of `Audio8-ASR-0.1B`:
55
+
56
+ - Audio tower/head: compiled Core ML `mlmodelc` with mixed Float16/Int8
57
+ storage, Float16 compute/output tensors, and ANE execution.
58
+ - Decoder: ONNX Runtime CPU decoder with int4 shared language-model weights
59
+ (`lm_shared_int4.data`) and int4 prefill/decode ONNX graphs.
60
+ - Token embedding table: Float16 (`token_embedding_fp16.bin`).
61
+
62
+ On a physical iPhone with the Core ML audio tower running on ANE, the demo is
63
+ designed to keep runtime memory footprint around 200 MB. The example below
64
+ shows a 183 MB app footprint during a microphone transcription run, with sampled
65
+ peak footprint varying by device, iOS version, cold/warm start state, and
66
+ measurement window. We position this package as one of the smallest usable ASR
67
+ model stacks for on-device iPhone transcription.
68
+
69
+ <p align="center">
70
+ <img src="assets/iphone-asr-demo-footprint.png" alt="Audio8 ASR iPhone demo memory footprint" width="360">
71
+ </p>
72
+
73
  ## Quick Start
74
 
75
  ```bash