How to use Vortex5/Mystic-Matron-12B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Vortex5/Mystic-Matron-12B", dtype="auto")
Fast and quick on my Nvidia 4090.So far intelligent and creative responses in role-play sessions.
· Sign up or log in to comment
