Inference Providers
Active filters: instruct
Qwen/Qwen2-0.5B-Instruct-GGUF
Text Generation
• 0.5B • Updated • 59.5k
• 71
Qwen/Qwen2-72B-Instruct-GGUF
Text Generation
• 73B • Updated • 1.03k
• 31
mradermacher/Pantheon-RP-1.0-8b-Llama-3-i1-GGUF
8B • Updated • 90
• 2
maria-ai/Gistral-16B-Q4_K_S-GGUF
Text Generation
• 17B • Updated • 10
• 1
Vikhrmodels/it-5.3-fp16-32k-GGUF
8B • Updated • 119
• 2
Qwen/Qwen2-1.5B-Instruct-GGUF
Text Generation
• 2B • Updated • 17.9k
• 27
Ayyystin/Llama-3-8B-Lexi-Uncensored-Q4_0-GGUF
8B • Updated • 49
• 2
mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF
47B • Updated • 51
• 1
mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF
47B • Updated • 89
• 2
mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-i1-GGUF
47B • Updated • 80
• 5
mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-i1-GGUF
47B • Updated • 110
kaizuberbuehler/Alpesteibock-Llama-3-8B-Alpha
Text Generation
• 8B • Updated • 6
• 1
mradermacher/Writing_Partner_Mistral_7B-GGUF
7B • Updated • 36
• 1
mradermacher/Autolycus-Mistral_7B-GGUF
7B • Updated • 8
mradermacher/Autolycus-Mistral_7B-i1-GGUF
7B • Updated • 97
mradermacher/Writing_Partner_Mistral_7B-i1-GGUF
7B • Updated • 28
• 1
wyan/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF
8B • Updated • 20
• 1
wyan/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF
8B • Updated • 17
• 2
Vikhrmodels/it-5.3-fp16-32k-EXL2
mlx-community/Hermes-2-Theta-Llama-3-8B-4bit
Text Generation
• 1B • Updated • 2
• 1
mlx-community/Hermes-2-Theta-Llama-3-8B-8bit
Text Generation
• 2B • Updated • 2
• 1
Qwen/Qwen2-57B-A14B-Instruct-GGUF
Text Generation
• 57B • Updated • 726
• 17
mradermacher/Einstein-v4-Qwen-1.5-32B-GGUF
33B • Updated • 23
mradermacher/Einstein-v4-Qwen-1.5-32B-i1-GGUF
33B • Updated • 173
• 3
vicky4s4s/Hermes-2-Pro-Mistral-7B
Text Generation
• 7B • Updated mradermacher/Alpesteibock-Llama-3-8B-Alpha-GGUF
8B • Updated • 216
• 2
jdcrutchley/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF
8B • Updated • 26
mradermacher/Hermes-2-Theta-Llama-3-8B-32k-GGUF
8B • Updated • 188
• 6
FlorianJc/Hermes-2-Pro-Mistral-7B-vllm-fp8
Text Generation
• 7B • Updated mradermacher/Hermes-2-Theta-Llama-3-8B-32k-i1-GGUF
8B • Updated • 46
• 2