Duplicated from bartowski/arcee-ai_Trinity-Large-Preview-GGUF
How to use arcee-ai/Trinity-Large-Preview-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arcee-ai/Trinity-Large-Preview-GGUF", device_map="auto")
krustik