How to use ArtusDev/Vortex5_Poetic-Rune-12B-EXL3 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ArtusDev/Vortex5_Poetic-Rune-12B-EXL3", dtype="auto")
