HuggingFaceM4/the_cauldron
Viewer • Updated • 1.88M • 690k • 545
How to use josephnguyencse/SmolVLM2-500M-Video-Instruct-8bit with Transformers:
# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText
processor = AutoProcessor.from_pretrained("josephnguyencse/SmolVLM2-500M-Video-Instruct-8bit")
model = AutoModelForImageTextToText.from_pretrained("josephnguyencse/SmolVLM2-500M-Video-Instruct-8bit")How to use josephnguyencse/SmolVLM2-500M-Video-Instruct-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir SmolVLM2-500M-Video-Instruct-8bit josephnguyencse/SmolVLM2-500M-Video-Instruct-8bit
This model was converted to MLX format from HuggingFaceTB/SmolVLM2-500M-Video-Instruct using mlx-vlm version 0.1.13.
Refer to the original model card for more details on the model.
pip install -U mlx-vlm
python -m mlx_vlm.generate \
--image "" \
--prompt "" \
--model SmolVLM2-500M-Video-Instruct-mlx-8bit \
Quantized
Base model
HuggingFaceTB/SmolLM2-360M