Ornith 1.5 9B oQe
Collection
6 items • Updated
How to use scottlowry/Ornith-1.5-9B-oQ6e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Ornith-1.5-9B-oQ6e scottlowry/Ornith-1.5-9B-oQ6e
This model was quantized using oQ (oMLX v0.6.2) mixed-precision quantization.
6-bit
Base model
ornith-ai/Ornith-1.5-9B