Inference Providers
Active filters: imatrix
legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF
Text Generation
• 73B • Updated • 160
lmstudio-community/Qwen2-Math-7B-Instruct-GGUF
Text Generation
• 8B • Updated • 381
• 5
mradermacher/Ryze-Mistral-Nemo-Instruct-2407-8-i1-GGUF
20B • Updated • 391
bartowski/Qwen2-Math-72B-Instruct-GGUF
Text Generation
• 73B • Updated • 229
• 1
mradermacher/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-2.0-i1-GGUF
7B • Updated • 129
mradermacher/YetAnotherMerge-v0.5-i1-GGUF
12B • Updated • 122
• 1
mradermacher/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-3.0-i1-GGUF
7B • Updated • 192
lmstudio-community/Qwen2-Math-72B-Instruct-GGUF
Text Generation
• 73B • Updated • 208
• 2
mradermacher/magnum-12b-v2-i1-GGUF
12B • Updated • 397
• 1
mradermacher/NurseButtercup-4x7B-bf16-i1-GGUF
24B • Updated • 62
mradermacher/L3.1-70B-sunfall-v0.6.1-i1-GGUF
71B • Updated • 85
• 2
mradermacher/Mistral-Nemo-Instruct-2407-i1-GGUF
12B • Updated • 445
• 5
mradermacher/open-hermes-sd-finetune-erot-story-i1-GGUF
7B • Updated • 21
• 1
mradermacher/Orthrus-12b-v0.8-i1-GGUF
12B • Updated • 175
• 2
mradermacher/L3-bluuwhale-SAO-MIX-8B-V1_fp32-merge-calc-i1-GGUF
8B • Updated • 22
• 1
mradermacher/Viviana_V3-i1-GGUF
7B • Updated • 1.42k
• 1
mradermacher/Viviana_v1-i1-GGUF
7B • Updated • 58
mradermacher/Tess-3-Mistral-Large-2-123B-i1-GGUF
123B • Updated • 101
• 2
duyntnet/Hexoteric-7B-imatrix-GGUF
Text Generation
• 7B • Updated • 643
ngxson/Meta-Llama-3.1-8B-Instruct-Q8_0
8B • Updated • 4
mradermacher/ChatWaifu_v1.2.1-i1-GGUF
12B • Updated • 9
• 2
mradermacher/medibuddy-llm-9B-i1-GGUF
8B • Updated • 67
mradermacher/nemolita-21b-i1-GGUF
20B • Updated • 227
Nexesenex/Google_Gemma-2-9b-it_iMat_Custom_Quant_Stategies-GGUF
9B • Updated • 158
mradermacher/AlphaMonarch-7B-i1-GGUF
7B • Updated • 549
mradermacher/NemoDori-v0.1-12B-MS-i1-GGUF
12B • Updated • 146
• 1
mradermacher/L3.1-Siithamo-v0.1-8B-i1-GGUF
8B • Updated • 199
• 1
mradermacher/Viviana_V2-i1-GGUF
7B • Updated • 45
mradermacher/NemoDori-v0.2-12B-MN-BT-i1-GGUF
12B • Updated • 341
• 1
mradermacher/Bio-Medical-Llama-3.1-8B-i1-GGUF
8B • Updated • 1.33k
• 3