Update model card footprint and quantization notes
Browse files
README.md
CHANGED
|
@@ -40,6 +40,7 @@ locally; no network request is required by the SDK or demo app.
|
|
| 40 |
| `dist/ASRModels.bundle` | Prebuilt model assets: Core ML audio tower, ONNX decoder, tokenizer tables, and integrity manifest |
|
| 41 |
| `ASRDemo/` | Minimal iOS app for microphone recording and one-shot transcription |
|
| 42 |
| `ANEBench/` | Optional iOS app for Core ML / ANE latency and sustained-load checks |
|
|
|
|
| 43 |
| `GETTING_STARTED.md` | Reproducible setup, build, signing, and device-testing guide |
|
| 44 |
| `LICENSE` | Apache License 2.0 |
|
| 45 |
|
|
@@ -48,6 +49,27 @@ locally; no network request is required by the SDK or demo app.
|
|
| 48 |
- [Audio8-ASR-0.1B](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B): base model checkpoint.
|
| 49 |
- [Audio8-ASR-0.1B-onnx-runtime](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B-onnx-runtime): ONNX Runtime package.
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
## Quick Start
|
| 52 |
|
| 53 |
```bash
|
|
|
|
| 40 |
| `dist/ASRModels.bundle` | Prebuilt model assets: Core ML audio tower, ONNX decoder, tokenizer tables, and integrity manifest |
|
| 41 |
| `ASRDemo/` | Minimal iOS app for microphone recording and one-shot transcription |
|
| 42 |
| `ANEBench/` | Optional iOS app for Core ML / ANE latency and sustained-load checks |
|
| 43 |
+
| `assets/` | Screenshots and model-card media |
|
| 44 |
| `GETTING_STARTED.md` | Reproducible setup, build, signing, and device-testing guide |
|
| 45 |
| `LICENSE` | Apache License 2.0 |
|
| 46 |
|
|
|
|
| 49 |
- [Audio8-ASR-0.1B](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B): base model checkpoint.
|
| 50 |
- [Audio8-ASR-0.1B-onnx-runtime](https://huggingface.co/AutoArk-AI/Audio8-ASR-0.1B-onnx-runtime): ONNX Runtime package.
|
| 51 |
|
| 52 |
+
## Packaged Model Variant and Footprint
|
| 53 |
+
|
| 54 |
+
This release packages the iPhone ANE-oriented variant of `Audio8-ASR-0.1B`:
|
| 55 |
+
|
| 56 |
+
- Audio tower/head: compiled Core ML `mlmodelc` with mixed Float16/Int8
|
| 57 |
+
storage, Float16 compute/output tensors, and ANE execution.
|
| 58 |
+
- Decoder: ONNX Runtime CPU decoder with int4 shared language-model weights
|
| 59 |
+
(`lm_shared_int4.data`) and int4 prefill/decode ONNX graphs.
|
| 60 |
+
- Token embedding table: Float16 (`token_embedding_fp16.bin`).
|
| 61 |
+
|
| 62 |
+
On a physical iPhone with the Core ML audio tower running on ANE, the demo is
|
| 63 |
+
designed to keep runtime memory footprint around 200 MB. The example below
|
| 64 |
+
shows a 183 MB app footprint during a microphone transcription run, with sampled
|
| 65 |
+
peak footprint varying by device, iOS version, cold/warm start state, and
|
| 66 |
+
measurement window. We position this package as one of the smallest usable ASR
|
| 67 |
+
model stacks for on-device iPhone transcription.
|
| 68 |
+
|
| 69 |
+
<p align="center">
|
| 70 |
+
<img src="assets/iphone-asr-demo-footprint.png" alt="Audio8 ASR iPhone demo memory footprint" width="360">
|
| 71 |
+
</p>
|
| 72 |
+
|
| 73 |
## Quick Start
|
| 74 |
|
| 75 |
```bash
|