# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("radames/phi-2-quantized", trust_remote_code=True, dtype="auto")Quick Links
No model card
- Downloads last month
- 336
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="radames/phi-2-quantized", trust_remote_code=True)