How to use openbmb/MiniCPM-o-2_6 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6", trust_remote_code=True, dtype="auto")
vllm - ERROR - Failed to derive max model length: 'NoneType' object has no attribute 'huggingface_token'
Please provide more details including vllm version, error traceback and so on.
· Sign up or log in to comment