-
-
-
-
-
-
Inference Providers
Active filters:
4bit
legraphista/Llama-Guard-3-8B-IMat-GGUF
Text Generation
•
8B
•
Updated
•
654
•
5
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
123B
•
Updated
•
711
•
29
jhangmez/CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-lora-adapters
Text Generation
•
Updated
jhangmez/CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-q4_k_m
Text Generation
•
8B
•
Updated
•
23
•
1
ModelCloud/Mistral-Large-Instruct-2407-gptq-4bit
Text Generation
•
123B
•
Updated
•
9
•
1
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF
Text Generation
•
8B
•
Updated
•
1.26k
•
1
ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit
Text Generation
•
410B
•
Updated
•
4
•
2
legraphista/gemma-2-2b-it-IMat-GGUF
Text Generation
•
3B
•
Updated
•
393
•
2
legraphista/gemma-2-2b-IMat-GGUF
Text Generation
•
3B
•
Updated
•
288
•
1
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
7B
•
Updated
•
31
•
1
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
•
71B
•
Updated
•
1.04k
•
10
legraphista/internlm2_5-1_8b-chat-IMat-GGUF
Text Generation
•
2B
•
Updated
•
144
legraphista/internlm2_5-20b-chat-IMat-GGUF
Text Generation
•
20B
•
Updated
•
555
legraphista/shieldgemma-2b-IMat-GGUF
Text Generation
•
3B
•
Updated
•
239
legraphista/shieldgemma-9b-IMat-GGUF
Text Generation
•
9B
•
Updated
•
116
legraphista/shieldgemma-27b-IMat-GGUF
Text Generation
•
27B
•
Updated
•
1.95k
•
1
legraphista/Qwen2-Math-1.5B-Instruct-IMat-GGUF
Text Generation
•
2B
•
Updated
•
334
legraphista/Qwen2-Math-7B-Instruct-IMat-GGUF
Text Generation
•
8B
•
Updated
•
128
•
1
legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF
Text Generation
•
73B
•
Updated
•
165
ModelCloud/EXAONE-3.0-7.8B-Instruct-gptq-4bit
8B
•
Updated
•
56
•
3
legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF
Text Generation
•
8B
•
Updated
•
633
•
1
legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF
Text Generation
•
71B
•
Updated
•
373
•
1
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
5B
•
Updated
•
418
•
13
legraphista/Minitron-4B-Base-GGUF
Text Generation
•
4B
•
Updated
•
120
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
8B
•
Updated
•
29
legraphista/Llama-3.1-Storm-8B-IMat-GGUF
Text Generation
•
8B
•
Updated
•
266
legraphista/Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
•
4B
•
Updated
•
1.72k
legraphista/Mistral-NeMo-Minitron-8B-Base-IMat-GGUF
Text Generation
•
8B
•
Updated
•
314
•
1
legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
•
4B
•
Updated
•
579
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Text Generation
•
2B
•
Updated
•
36
•
3