Instructions to use mlx-community/llava-phi-3-mini-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/llava-phi-3-mini-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/llava-phi-3-mini-4bit --local-dir llava-phi-3-mini-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
mlx-community/llava-phi-3-mini-4bit
This model was converted to MLX format from qnguyen3/nanoLLaVAxtuner/llava-phi-3-mini-hf using mlx-vllm version 0.0.3.
Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/llava-phi-3-mini-4bit \
--prompt "what are these?" --image "http://images.cocodataset.org/val2017/000000039769.jpg" \
--max-tokens 100 --temp 0.0
- Downloads last month
- 134
Model size
4B params
Tensor type
U32
ยท
F16 ยท
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support