uni2005-onnx / README.md
KitsuMate's picture
Release Uni2005 ONNX model assets
cb36e06 verified
|
Raw
History Blame Contribute Delete
2.22 kB
---
license: gpl-3.0
tags:
- onnx
- allosaurus
- phoneme-recognition
- speech
- lipsync
library_name: onnxruntime
---
# Uni2005 ONNX
An ONNX export of the **Uni2005** universal phoneme-recognition acoustic model
from [Allosaurus](https://github.com/xinjli/allosaurus). It is published by
KitsuMate as a separately downloadable runtime model for
`ai.kitsumate.onnx.lipsync`; it is not bundled in the Unity package.
## Contents
| File | Purpose | SHA-256 |
| --- | --- | --- |
| `uni2005.onnx` | Float32 ONNX acoustic model | `517b07ccd197b8acb2c18c3f6ca19e1e8fd489b81853e386720917e01d43de1e` |
| `phone.txt` | Universal phone inventory | `bfe6cd8566c2c3a158da6134ba0d067d179123f6adfcac8ea9c7e44671423848` |
| `vocab.json` | CTC token-to-phone mapping | `8dbf53951b7ac3379b4f6dcfdb9f6b659f588fac7d4fa04c1395876f0462a338` |
`checksums.sha256` is the machine-readable form of these hashes.
## Model contract
- Input: `mfcc`, `float32`, shape `[batch, time, 120]` (dynamic batch/time).
- Output: `logits`, `float32`, shape `[batch, time, 230]`.
- Audio preprocessing: 8 kHz mono audio; 25 ms window; 10 ms hop; 40 MFCC
coefficients with speaker CMVN, three-frame context windows, and a factor-3
subsample. The model does not perform resampling or MFCC extraction.
- Decode the output with CTC using `vocab.json`.
The repository currently publishes the full-precision export only. It has not
been qualified for every ONNX runtime or Unity AI Inference operator set.
## Provenance and licence
The model is derived from the `uni2005` model in
[xinjli/allosaurus](https://github.com/xinjli/allosaurus), recorded here at
commit `d9f1adaf47d3b3765b41f4177da62a051516d636`. See [NOTICE](NOTICE) for
attribution and the included [GPL-3.0 licence](LICENSE) for terms.
KitsuMate does not claim authorship of the original Allosaurus model and does
not imply endorsement by its authors. The source model and these redistributed
artifacts are covered by GPL-3.0 as confirmed for this publication.
## Use with KitsuMate ONNX
Pin a Hugging Face commit revision and verify the published SHA-256 before
placing the three runtime files in your application's model cache. Do not add
them to a UPM package archive.