Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,567

Base only

Active filters: instruct

mradermacher/AlphaMonarch-laser-i1-GGUF

7B • Updated Nov 11, 2024 • 70

mradermacher/NeuralHermes-2.5-Mistral-7B-laser-GGUF

7B • Updated Nov 11, 2024 • 25

tensorblock/Medical-Llama3-8B-GGUF

8B • Updated Jan 27 • 80

mradermacher/NeuralHermes-2.5-Mistral-7B-laser-i1-GGUF

7B • Updated Nov 11, 2024 • 106

mradermacher/Llama3.1-70B-ShiningValiant2-GGUF

71B • Updated Nov 12, 2024 • 61

m1guelperez/Medical-Llama3-8B-Q4_0-GGUF

8B • Updated Nov 11, 2024 • 6

m1guelperez/Medical-Llama3-8B-Q8_0-GGUF

8B • Updated Nov 12, 2024 • 6

tensorblock/Llama-3-8B-Lexi-Uncensored-GGUF

8B • Updated Jan 27 • 170 • 1

tensorblock/llama-3-typhoon-v1.5-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 27

mradermacher/Pantheon-RP-1.6.2-22b-Small-GGUF

22B • Updated Nov 13, 2024 • 26

mradermacher/Genstruct-7B-GGUF

7B • Updated Nov 13, 2024 • 38 • 2

tensorblock/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • 8B • Updated Jan 27 • 24

mradermacher/Llama3.1-70B-ShiningValiant2-i1-GGUF

71B • Updated Nov 12, 2024 • 72

mradermacher/Pantheon-RP-1.6-12b-Nemo-GGUF

12B • Updated Nov 14, 2024 • 20

mradermacher/Pantheon-RP-1.6-12b-Nemo-KTO-GGUF

12B • Updated Nov 14, 2024 • 37 • 1

tensorblock/Einstein-v7-Qwen2-7B-GGUF

8B • Updated Jan 27 • 83

mradermacher/Pantheon-RP-1.6.1-12b-Nemo-GGUF

12B • Updated Nov 15, 2024 • 36 • 2

tensorblock/Llama-2-ko-OpenOrca-gugugo-13B-GGUF

Text Generation • 13B • Updated Jan 27 • 4

mradermacher/Genstruct-7B-i1-GGUF

7B • Updated Nov 13, 2024 • 15 • 1

mradermacher/Pantheon-RP-1.6.2-22b-Small-i1-GGUF

22B • Updated Nov 13, 2024 • 50

ModelCloud/Qwen2.5-Coder-32B-Instruct-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Nov 14, 2024 • 84 • 16

mradermacher/Llama3.1-8B-Cobalt-GGUF

8B • Updated Nov 15, 2024 • 144

mradermacher/Llama3.1-8B-Enigma-GGUF

8B • Updated Nov 15, 2024 • 173

tensorblock/llama2-13b.kor.v2-GGUF

Text Generation • 13B • Updated Jan 27 • 10

tensorblock/gemma-7b-openhermes-v0.80-GGUF

Text Generation • 9B • Updated Jan 27 • 43

mradermacher/Pantheon-RP-1.6-12b-Nemo-i1-GGUF

12B • Updated Nov 14, 2024 • 24

mradermacher/Pantheon-RP-1.6-12b-Nemo-KTO-i1-GGUF

12B • Updated Nov 14, 2024 • 54 • 1

tensorblock/BgGPT-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 27 • 19

tensorblock/Qwen2.5-Lumen-14B-GGUF

Text Generation • 15B • Updated Jan 27 • 23 • 1

tensorblock/llama2-13b.kor.v1-GGUF

Text Generation • 13B • Updated Jan 27 • 156