Instructions to use arcee-ai/Trinity-Large-Preview-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use arcee-ai/Trinity-Large-Preview-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arcee-ai/Trinity-Large-Preview-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K
- Trinity-Large-Preview-IQ1_M
- Trinity-Large-Preview-IQ1_S
- Trinity-Large-Preview-IQ2_M
- Trinity-Large-Preview-IQ2_S
- Trinity-Large-Preview-IQ2_XS
- Trinity-Large-Preview-IQ2_XXS
- Trinity-Large-Preview-IQ3_M
- Trinity-Large-Preview-IQ3_XS
- Trinity-Large-Preview-IQ3_XXS
- Trinity-Large-Preview-IQ4_NL
- Trinity-Large-Preview-IQ4_XS
- Trinity-Large-Preview-Q2_K
- Trinity-Large-Preview-Q2_K_L
- Trinity-Large-Preview-Q3_K_L
- Trinity-Large-Preview-Q3_K_M
- Trinity-Large-Preview-Q3_K_S
- Trinity-Large-Preview-Q3_K_XL
- Trinity-Large-Preview-Q4_0
- Trinity-Large-Preview-Q4_1
- Trinity-Large-Preview-Q4_K_L
- Trinity-Large-Preview-Q4_K_M
- Trinity-Large-Preview-Q4_K_S
- Trinity-Large-Preview-Q5_K_L
- Trinity-Large-Preview-Q5_K_M
- Trinity-Large-Preview-Q5_K_S
- Trinity-Large-Preview-Q6_K
- Trinity-Large-Preview-Q6_K_L
- Trinity-Large-Preview-Q8_0
- 22.4 kB
- 2.62 kB
- 4.89 kB