--- license: other license_name: funasr-model-license-1.1 license_link: https://github.com/modelscope/FunASR/blob/main/MODEL_LICENSE library_name: coremltools pipeline_tag: automatic-speech-recognition base_model: FunAudioLLM/SenseVoiceSmall language: - zh - en - yue - ja - ko tags: - coreml - apple-silicon - automatic-speech-recognition - speech-understanding - emotion-recognition - audio-event-detection - multilingual - macos --- # SenseVoiceSmall — Core ML for Apple Silicon A ready-to-use Core ML conversion of [FunAudioLLM/SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) for fast, private speech recognition and rich audio understanding on Apple Silicon. SenseVoiceSmall performs transcription, spoken-language identification, speech-emotion recognition, and audio-event detection in one non-autoregressive model. It is integrated into [Hugging Mac](https://github.com/devilyouwei/hugging-mac) for building local macOS voice apps, services, plugins, and agents. ## Capabilities - Speech recognition for Chinese, English, Cantonese, Japanese, and Korean - Automatic spoken-language identification - Emotion recognition: happy, sad, angry, neutral, fearful, disgusted, and surprised - Audio-event detection including music, applause, laughter, crying, coughing, sneezing, breathing, singing, and speech noise - Optional inverse text normalization - Short-form audio up to 30 seconds at 16 kHz ## Core ML model The bundle contains one multifunction ML Program with three fixed feature buckets. Hugging Mac automatically selects the smallest suitable function. | Function | `features` input | Other inputs | `logits` output | |---|---|---|---| | `encoder_100` | `1 × 100 × 560` FP32 | `lengths`, `language_id`, `style_id`: `1` INT32 | `1 × 104 × 25055` FP16 | | `encoder_250` | `1 × 250 × 560` FP32 | `lengths`, `language_id`, `style_id`: `1` INT32 | `1 × 254 × 25055` FP16 | | `encoder_500` | `1 × 500 × 560` FP32 | `lengths`, `language_id`, `style_id`: `1` INT32 | `1 × 504 × 25055` FP16 | - Architecture: non-autoregressive SANM encoder with CTC output - Weight optimization: INT8 linear quantization - Compute precision: FP16 - Minimum deployment target: macOS 15 - Package size: 238.7 MB - Default function: `encoder_500` The inputs are 560-dimensional acoustic features generated with the included `am.mvn` normalization statistics. Raw logits require CTC collapse, SentencePiece decoding, and parsing of rich language, emotion, and event tokens. The tokenizer is downloaded from the pinned upstream repository by Hugging Mac. ## Use with Hugging Mac ```bash git clone https://github.com/devilyouwei/hugging-mac.git cd hugging-mac uv sync --all-packages uv run hugging-mac-web ``` Open the Models page, install **SenseVoiceSmall Core ML**, and use it through Live Transcription or the `SpeechTranscription` and `SpeechUnderstanding` capabilities. For feature extraction, Core ML invocation, CTC decoding, and structured rich-transcript parsing, see the [Hugging Mac SenseVoice SDK](https://github.com/devilyouwei/hugging-mac/tree/main/packages/hugging_mac_sdk/src/hugging_mac_sdk/models/sensevoice). ## Provenance and integrity - Upstream model: [FunAudioLLM/SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) - Upstream revision: `3847d57b6bdf2dd8875cb1508d2af43d80a16bf7` - Conversion format: `sensevoice-small-coreml` - Conversion metadata: included in `sensevoice-small-coreml/conversion.json` - Directory SHA-256: `6ec1ee9247f7c717a285d809967bd64e210dbba4418e872c01a7a60bdedbb983` ## License The converted model retains the **FunASR Model Open Source License Agreement 1.1** and its attribution and usage conditions. Review the linked license before redistribution or commercial use. Hugging Mac is an independent open-source project and is not affiliated with or endorsed by FunAudioLLM, FunASR, or ModelScope.