Instructions to use llava-hf/LLaVA-NeXT-Video-7B-hf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use llava-hf/LLaVA-NeXT-Video-7B-hf with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("llava-hf/LLaVA-NeXT-Video-7B-hf") model = AutoModelForMultimodalLM.from_pretrained("llava-hf/LLaVA-NeXT-Video-7B-hf", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Fix model_type to llava_next_video
#4
by YangshenDeng - opened
Set model_type to "llava_next_video" such that the LlavaNextVideoConfig can be correctly loaded when using AutoConfig.from_pretrained
right, thanks for fixing!
RaushanTurganbay changed pull request status to merged