premove-itn / README.md
aryamantodkar's picture
Publish Premove ITN v0.2.0 model
e42a6ad verified
|
Raw
History Blame Contribute Delete
2.36 kB
---
library_name: premove-itn
language: [en]
base_model: [microsoft/deberta-v3-large]
tags: [inverse-text-normalization, speech-processing, voice-agents]
license: mit
---
# Premove ITN v0.2.0
This release updates the contextual candidate scorer used by `premove-itn`.
The deterministic Rust candidate generators and exact decoder are unchanged.
Load it through the matching Python package:
```python
from premove_itn import PremoveITN
itn = PremoveITN.from_pretrained(revision="v0.2.0")
print(itn.normalize("meet me at two thirty"))
# meet me at 02:30
```
## Training
The v0.1.0 scorer was adapted for three epochs on 7,440 controlled,
single-collision TIME-versus-identifier records. No replay or dual-collision
examples were used. Epoch 3 was selected using a separate 200-row development
set before any frozen test was inspected.
## Results
| Metric | v0.1.0 | v0.2.0 |
| --- | ---: | ---: |
| Context record | 51.2% | **86.2%** |
| Counterfactual pair | 6.4% | **72.4%** |
| Identifier | 29.6% | **98.0%** |
| Time | 72.8% | **74.4%** |
| Dual span | 45.0% | **96.0%** |
| Dual sentence exact | 16.0% | **92.0%** |
| Broad strict exact | 40.5% | **43.7%** |
The contextual and dual benchmarks are synthetic controlled evaluations. They
do not estimate production voice-agent accuracy. The broad benchmark gained 86
new exact rows and lost 38 previously exact rows. Localized losses were most
visible in ORDINAL, MONEY, URL, and DIGIT_SEQUENCE.
## Limitations
- TIME recall on the controlled single-collision test is 74.4%, substantially
below the 98.0% identifier result.
- The model is English-only and requires the `premove-itn` candidate graph and
decoder. It is not a generic Transformers model.
- The approximately 435.6M-parameter scorer has a large download and
multi-second initialization cost.
## Release identity
- Artifact version: `v0.2.0`
- Required package version: `0.2.0`
- Hub repository: `premove-ai/premove-itn`
- Base model: `microsoft/deberta-v3-large`
- Base revision: `64a8c8eab3e352a784c658aef62be1662607476f`
- Source checkpoint SHA-256: `10a338d57b6d619f52259a58aca210ecb78f47de44baf0c25477a8f5b06b5d39`
- Model SHA-256: `0b6f36aa32311d0c495e1c5307d5e34463e52b4dc283ab9030bc2f54e1bf1152`
Source and evaluation evidence are available from
[`premove-ai/premove-itn`](https://github.com/premove-ai/premove-itn).