if self.sampler is not None: AttributeError: 'LlamaModel' object has no attribute 'sampler'
#8
by Linus4Lyf - opened
Trying to run the model with:
from langchain_community.chat_models import ChatLlamaCpp
Gives:
if self.sampler is not None: AttributeError: 'LlamaModel' object has no attribute 'sampler'
The same setup works fine with Qwen3-4B-Instruct-2507-Q8_0.gguf, but returns this error with the thinking version.
Linus4Lyf changed discussion status to closed
Meant to put this on the unsloth gguf