-
-
-
-
-
-
Inference Providers
Active filters:
instruct
tensorblock/Llama3-70B-Fireplace-GGUF
Text Generation
•
71B
•
Updated
•
58
sapienzanlp/Minerva-7B-instruct-v1.0-GGUF
Text Generation
•
7B
•
Updated
•
124
•
5
zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF
27.3M
•
Updated
•
2
mradermacher/Novus-7b-tr_v1-GGUF
7B
•
Updated
•
50
•
1
mradermacher/Novus-7b-tr_v1-i1-GGUF
7B
•
Updated
•
84
•
1
mradermacher/Genstruct-10.7B-GGUF
11B
•
Updated
•
5
Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF
Text Generation
•
13B
•
Updated
•
3
Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF
Text Generation
•
13B
•
Updated
•
12
mradermacher/Genstruct-10.7B-i1-GGUF
11B
•
Updated
•
81
SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF
8B
•
Updated
•
6
•
1
mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF
71B
•
Updated
•
150
•
1
hierholzer/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
44
•
1
NousResearch/Hermes-3-Llama-3.2-3B-GGUF
3B
•
Updated
•
1.18k
•
57
bartowski/Hermes-3-Llama-3.2-3B-GGUF
Text Generation
•
Updated
•
6.58k
•
12
mlx-community/Hermes-3-Llama-3.2-3B-4bit
Text Generation
•
0.5B
•
Updated
•
443
mlx-community/Hermes-3-Llama-3.2-3B-8bit
Text Generation
•
0.9B
•
Updated
•
33
•
1
mlx-community/Hermes-3-Llama-3.2-3B-bf16
Text Generation
•
3B
•
Updated
•
17
Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF
3B
•
Updated
•
1
Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF
3B
•
Updated
•
20
•
1
Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF
3B
•
Updated
•
2
•
1
Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF
3B
•
Updated
•
5
•
1
Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF
3B
•
Updated
•
1
•
1
Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF
3B
•
Updated
•
1
•
1
tensorblock/BgGPT-7B-Instruct-v0.1-GGUF
7B
•
Updated
•
38
mradermacher/Llama3-OpenBioLLM-70B-GGUF
71B
•
Updated
•
110
•
1
NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF
3B
•
Updated
•
7
•
2
namelessai/mythalion-13b-Q4_K_M-GGUF
Text Generation
•
13B
•
Updated
•
40
•
2
mradermacher/Hermes-3-Llama-3.2-3B-GGUF
3B
•
Updated
•
56
•
2
mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF
3B
•
Updated
•
53
•
1
QuantFactory/Hermes-3-Llama-3.2-3B-GGUF
4B
•
Updated
•
357
•
3