File size: 1,916 Bytes
46d21a3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 | ---
base_model: deepgrove/maple-preview
base_model_relation: quantized
language:
- en
library_name: onnxruntime
license: mit
pipeline_tag: text-generation
tags:
- onnx
- onnxruntime
- android
- maple
- mixture-of-experts
- quantized
- openmed
---
# Maple Preview 4-bit ONNX for Android
Private OpenMed development export of
[`deepgrove/maple-preview`](https://huggingface.co/deepgrove/maple-preview)
revision `ac1ddd79d2b5cb4406f5d2bebdf95406ce505a07` for ONNX Runtime Mobile.
The expert matrices use symmetric 4-bit, 128-value blocks through the fused
`com.microsoft.QMoE` operator. Router computation and the public graph I/O use
FP32. The included `openmed-maple-onnx-export.json` is the integrity receipt
for every file, source revision, conversion dependency, and validation gate.
## Validation status
The complete 24-layer graph passed ONNX checker and OpenMed's graph contract.
On ONNX Runtime 1.25.1 CPU it completed a real one-token prefill and cached
decode with finite logits and KV growth from one to two tokens. The exact fused
QMoE form also passes the standalone operator smoke test.
Source-logit parity, useful generation, direct-identifier recall,
critical-leakage, peak memory, latency, and physical Android execution remain
release gates. This is conversion and CPU-runtime evidence only.
## Integration
The cache contract, bundle validator, and Compose demo are documented in
[`docs/maple-on-device.md`](https://github.com/maziyarpanahi/openmed/blob/master/docs/maple-on-device.md).
Applications must verify the receipt's sizes and SHA-256 digests before moving
the selected model into protected app storage. Do not add cloud fallback for
PHI workflows.
Maple Preview is a research model, not a medical device. It must not
automatically trigger clinical or disclosure decisions. The upstream model is
licensed under MIT; see its repository for the license and model card.
|