---
license: apache-2.0
base_model: openai/whisper-small
library_name: basert
pipeline_tag: automatic-speech-recognition
tags:
  - basert
  - apple-silicon
  - whisper
  - speech-recognition
---

# whisper-small

[BaseRT](https://github.com/basecompute/baseRT) `.base` build of
[`openai/whisper-small`](https://huggingface.co/openai/whisper-small),
OpenAI's 244M-parameter Whisper speech-recognition model,
for fast local transcription on Apple Silicon.

## Files

| File | Precision | Size |
|------|-----------|------|
| `whisper-small-F16.base` | float16 | 489 MB |
| `whisper-small-Q8.base` | 8-bit linears, f16 embeddings/conv/norms | 297 MB |
| `whisper-small-Q4.base` | 4-bit linears, f16 embeddings/conv/norms | 204 MB |

F16 and Q8 are transcription-quality equivalent (Q8 passes the same
word-error parity gates against reference openai-whisper). Q4 is the
smallest and remains accurate; on some smaller variants it can
occasionally repeat a word in timestamped beam decoding.

## Usage

```bash
curl -LsSf https://basecompute.co/install.sh | sh
basert serve --model whisper-small-F16.base
```

`POST /v1/audio/transcriptions` (multipart or JSON) returns `json`, `text`,
`srt`, `vtt`, or `verbose_json` (with per-segment `avg_logprob` /
`no_speech_prob` / `compression_ratio` / `temperature` and the detected
`language`), with optional SSE streaming and `POST /v1/audio/translations`. Supported
request fields: `language` (or `"auto"` to detect), `prompt`
(initial prompt / vocabulary bias), `task` (`transcribe`/`translate`). Or transcribe directly
from the CLI:

```bash
basert-transcribe whisper-small-F16.base audio.wav --lang auto
```

Multilingual: pass `language` (e.g. `--lang de`), or `auto` to detect, across the 99 supported languages. `task=translate` produces English from any source language (also via `POST /v1/audio/translations`).

Released under the apache-2.0 license, inherited from the base model.