File size: 4,764 Bytes
176446a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
---
license: apache-2.0
base_model: openai/whisper-tiny
pipeline_tag: automatic-speech-recognition
library_name: openasr
tags:
  - automatic-speech-recognition
  - speech-to-text
  - openasr
  - oasr
  - whisper-tiny
---

<div align="center">

# Whisper Tiny Β· OpenASR

**The smallest multilingual Whisper for fast local transcription**

[![License](https://img.shields.io/badge/license-Apache--2.0-2563eb.svg)](https://huggingface.co/openai/whisper-tiny/blob/main/README.md)
[![Format](https://img.shields.io/badge/format-.oasr-7c3aed.svg)](https://github.com/QuintinShaw/openasr)
[![Runtime](https://img.shields.io/badge/runtime-OpenASR-111827.svg)](https://openasr.org)
[![Base model](https://img.shields.io/badge/base-whisper--tiny-f59e0b.svg)](https://huggingface.co/openai/whisper-tiny)

Native speech-to-text in the **[OpenASR](https://github.com/QuintinShaw/openasr)** runtime β€”
engineered for peak performance on CPU & GPU, **no Python at inference time**.

</div>

---

## ✨ Highlights

- 🎧 **Multilingual ASR** β€” transcribes many languages and can translate speech to English
- ⚑ **39M parameters** β€” the smallest Whisper checkpoint, the fastest and lightest to run
- 🌐 **Weak-supervision scale** β€” trained with Whisper's 680k-hour labelled speech corpus
- πŸ¦€ **Native in OpenASR** β€” `.oasr` packs run with no Python at inference, engineered for peak performance on CPU & GPU

## πŸš€ Quickstart

```bash
# 1. Install the OpenASR CLI  Β·  https://openasr.org
# 2. Pull a build (pick a quant β€” see the table below)
openasr pull whisper-tiny:q8

# 3. Transcribe
openasr transcribe audio.wav --model whisper-tiny
```

All builds for this model:

```bash
openasr pull whisper-tiny:fp16
openasr pull whisper-tiny:q8
openasr pull whisper-tiny:q4
```

## πŸ“¦ Available builds

| Quant | File (`.oasr`) | Size | RAM peak | RTF Β· M1 CPU | RTF Β· M1 GPU | JFK Ξ”WER vs fp16 |
|:------|:---------------|-----:|---------:|-------------:|-------------:|-----------------:|
| fp16 | `whisper-tiny-fp16.oasr` | 79 MB | 321 MB | 0.04Γ— | 0.03Γ— | 0.0% |
| q8_0 | `whisper-tiny-q8_0.oasr` | 63 MB | 275 MB | 0.04Γ— | 0.03Γ— | 0.0% |
| q4_k | `whisper-tiny-q4_k.oasr` | 61 MB | 274 MB | 0.04Γ— | 0.03Γ— | 0.0% |

<sub>RTF = real-time factor on the fixed 11s JFK clip (**lower is faster**); RAM peak measured per pack
in an isolated subprocess. JFK Ξ”WER compares each quantized build's JFK transcript to this model's
fp16 JFK transcript, so it measures quantization drift rather than absolute recognition accuracy.
**q8_0** is the recommended default β€” near-reference quality at a fraction of the
footprint.</sub>

## 🧠 About Whisper Tiny

Whisper Tiny is OpenAI's 39M-parameter multilingual Whisper checkpoint, the smallest member of
the Whisper family. It uses the standard Whisper encoder-decoder architecture for automatic
speech recognition and speech translation, trained with large-scale weak supervision on 680k
hours of labelled speech. The tiny model trades some accuracy for the lowest footprint and
fastest inference, which suits low-resource devices and latency-sensitive use. This OpenASR
repo repackages the original `openai/whisper-tiny` weights as `.oasr` packs that run natively
in the OpenASR runtime with no Python at inference time. For most users the q8_0 build is the
recommended default; q4_k is for the tightest memory budgets and fp16 is for verification or
maximum fidelity.

## βš™οΈ How these packs were made

Converted from [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) with the OpenASR importer:

```bash
openasr model-pack import-whisper-local <src> <out>.oasr \
  --package-id whisper-tiny --quantization {fp16,q8-0,q4-k}
```

The `.oasr` container is GGUF-backed; packs use zero-copy mmap weight binding and graph
buffer reuse to keep peak memory low.

## βš–οΈ License

These packs **inherit the upstream model's license: Apache-2.0**
([source](https://huggingface.co/openai/whisper-tiny/blob/main/README.md)). OpenASR packaging retains the upstream copyright and
NOTICE; the only modifications are format conversion and quantization.

## πŸ™ Acknowledgements

This pack is a redistribution of **Whisper Tiny**, released by **OpenAI**
([openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny)).
All credit for the original model, training recipe, and weights belongs to OpenAI. The
upstream Hugging Face model card declares Apache-2.0 licensing; OpenASR only converts the
weights into `.oasr` packages and adds quantized builds for local runtime use.

## πŸ”— Links

- πŸ¦€ **OpenASR** β€” <https://github.com/QuintinShaw/openasr>
- 🌐 **Website** β€” <https://openasr.org>
- πŸ€— **Upstream model** β€” [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny)