How to use hari02/idefics2-8b-report_4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hari02/idefics2-8b-report_4bit", dtype="auto")