Requantize models 3d1da7a
Sergey Kostyaev commited on
How to use NeoDim/starchat-alpha-GGML with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("NeoDim/starchat-alpha-GGML", dtype="auto")