RedHatAI
/

Llama-3.2-11B-Vision-Instruct-quantized.w4a16

text-generation-inference

compressed-tensors

Model card Files Files and versions

kylesayrs commited on Feb 13

Commit

7f66874

·

verified ·

1 Parent(s): 7e1d5b9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -44,7 +44,7 @@ from vllm.assets.image import ImageAsset
 from vllm import LLM, SamplingParams
 # prepare model
-model_id = "neuralmagic/Llama-3.2-11B-Vision-Instruct-W4A16-G128"
 llm = LLM(
     model=model_id,
     max_model_len=4096,

 from vllm import LLM, SamplingParams
 # prepare model
+model_id = "neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16"
 llm = LLM(
     model=model_id,
     max_model_len=4096,