Instructions to use llava-hf/LLaVA-NeXT-Video-7B-hf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use llava-hf/LLaVA-NeXT-Video-7B-hf with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("llava-hf/LLaVA-NeXT-Video-7B-hf") model = AutoModelForMultimodalLM.from_pretrained("llava-hf/LLaVA-NeXT-Video-7B-hf", device_map="auto") - Notebooks
- Google Colab
- Kaggle
No Model Found
#16
by x-desquesnes - opened
Hi,
trying to run the first example, I got this error message :
Traceback (most recent call last):
File "/home/xavier/llava/test.py", line 9, in <module>
model = LlavaNextVideoForConditionalGeneration.from_pretrained(
File "/opt/anaconda3/envs/llava/lib/python3.10/site-packages/transformers/modeling_utils.py", line 317, in _wrapper
return func(*args, **kwargs)
File "/opt/anaconda3/envs/llava/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4923, in from_pretrained
checkpoint_files, sharded_metadata = _get_resolved_checkpoint_files(
File "/opt/anaconda3/envs/llava/lib/python3.10/site-packages/transformers/modeling_utils.py", line 1131, in _get_resolved_checkpoint_files
raise OSError(
OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory llava-hf/LLaVA-NeXT-Video-7B-hf.
It looks like the model can not be found.
How can I fix it ?
Thanks