Exl2 Quants
Collection
2 items • Updated
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("tssst/phi-4-exl2", dtype="auto")Quick Links
Model tree for tssst/phi-4-exl2
Base model
microsoft/phi-4# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("tssst/phi-4-exl2", dtype="auto")Base model
microsoft/phi-4
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="tssst/phi-4-exl2")