How to use cyan2k/Janus-Pro-7B-bnb-4bit with Transformers:
# Load model directly from transformers import MultiModalityCausalLM model = MultiModalityCausalLM.from_pretrained("cyan2k/Janus-Pro-7B-bnb-4bit", dtype="auto")
