Instructions to use vanch007/SenseVoiceSmall-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use vanch007/SenseVoiceSmall-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir SenseVoiceSmall-4bit vanch007/SenseVoiceSmall-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
File size: 579 Bytes
b5365ba | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | {
"model_type": "sensevoice",
"vocab_size": 25055,
"input_size": 560,
"encoder_conf": {
"output_size": 512,
"attention_heads": 4,
"linear_units": 2048,
"num_blocks": 50,
"tp_blocks": 20,
"dropout_rate": 0.1,
"attention_dropout_rate": 0.1,
"kernel_size": 11,
"sanm_shift": 0,
"normalize_before": true
},
"frontend_conf": {
"fs": 16000,
"window": "hamming",
"n_mels": 80,
"frame_length": 25,
"frame_shift": 10,
"lfr_m": 7,
"lfr_n": 6
},
"quantization": {
"group_size": 64,
"bits": 4
}
}
|