How to use openbmb/MiniCPM-o-2_6-int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6-int4", trust_remote_code=True, dtype="auto")
Thanks for your excellent work by introducing omni-version of minicpm. But as the title shows, autogptq may not receive new features and we can PR to ModelCloud/GPTQModel instead for future maintaining.
ModelCloud/GPTQModel
· Sign up or log in to comment
