forkjoin-ai/whisper-small-gguf

Whisper Small

Forkjoin.ai conversion of openai/whisper-small to GGUF format for edge deployment.

Model Details

• Source Model: openai/whisper-small
• Format: GGUF
• Converted by: Forkjoin.ai

Usage

With llama.cpp

./llama-cli -m whisper-small-gguf.gguf -p "Your prompt here" -n 256

With Ollama

Create a Modelfile:

FROM ./whisper-small-gguf.gguf

ollama create whisper-small-gguf -f Modelfile
ollama run whisper-small-gguf

About Forkjoin.ai

Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.

All conversions are optimized for edge deployment within browser and mobile memory constraints.

License

Apache 2.0 (follows upstream model license)