Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

4,015

Base only

Active filters: instruct

mradermacher/Llama3.1-8B-Cobalt-GGUF

8B • Updated Nov 15, 2024 • 424

mradermacher/Llama3.1-8B-Enigma-GGUF

8B • Updated Nov 15, 2024 • 416

tensorblock/llama2-13b.kor.v2-GGUF

Text Generation • 13B • Updated Jan 27 • 10

tensorblock/gemma-7b-openhermes-v0.80-GGUF

Text Generation • 9B • Updated Jan 27 • 52

mradermacher/Pantheon-RP-1.6-12b-Nemo-i1-GGUF

12B • Updated Nov 14, 2024 • 133

mradermacher/Pantheon-RP-1.6-12b-Nemo-KTO-i1-GGUF

12B • Updated Nov 14, 2024 • 579 • 1

tensorblock/BgGPT-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 27 • 103

tensorblock/Qwen2.5-Lumen-14B-GGUF

Text Generation • 15B • Updated Jan 27 • 39 • 1

tensorblock/llama2-13b.kor.v1-GGUF

Text Generation • 13B • Updated Jan 27 • 28

mradermacher/Pantheon-RP-1.6.1-12b-Nemo-i1-GGUF

12B • Updated Nov 15, 2024 • 767 • 1

mradermacher/Llama3.1-8B-Cobalt-i1-GGUF

8B • Updated Nov 15, 2024 • 600

mradermacher/Llama3.1-8B-Enigma-i1-GGUF

8B • Updated Nov 15, 2024 • 525

mradermacher/Llama3.1-8B-ShiningValiant2-GGUF

8B • Updated Nov 15, 2024 • 269

mradermacher/Llama3.1-8B-ShiningValiant2-i1-GGUF

8B • Updated Nov 15, 2024 • 717

INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0

Text Generation • 27B • Updated Dec 4, 2024 • 61 • • 17

INSAIT-Institute/BgGPT-Gemma-2-2.6B-IT-v1.0

Text Generation • 3B • Updated Dec 4, 2024 • 111 • • 7

INSAIT-Institute/BgGPT-Gemma-2-9B-IT-v1.0

Text Generation • 9B • Updated Dec 4, 2024 • 71 • • 11

mradermacher/ToxicHermes-2.5-Mistral-7B-GGUF

7B • Updated Nov 16, 2024 • 46 • 1

mradermacher/ToxicHermes-2.5-Mistral-7B-i1-GGUF

7B • Updated Nov 16, 2024 • 204

tensorblock/mythalion-13b-GGUF

Text Generation • 13B • Updated Jan 27 • 57

mradermacher/Lexi-Llama-3-8B-Uncensored-GGUF

8B • Updated Dec 15, 2024 • 330 • 1

mradermacher/mistral_7b_norobots-fp16-GGUF

7B • Updated Nov 17, 2024 • 68

tensorblock/Mistral-7B-Instruct-v0.2-GGUF

7B • Updated Jan 27 • 219

osllmai-community/mistral-7b-v0.3-bnb-4bit

Text Generation • 7B • Updated Jan 24, 2025 • 23

mradermacher/Lexi-Llama-3-8B-Uncensored-i1-GGUF

8B • Updated Dec 15, 2024 • 2.07k • 1

mradermacher/zephyr_7b_norobots-fp16-GGUF

7B • Updated Nov 17, 2024 • 115

mradermacher/Nous-Hermes-2-Mistral-7B-DPO-GGUF

7B • Updated Nov 17, 2024 • 445

mradermacher/Nous-Hermes-2-Mistral-7B-DPO-i1-GGUF

7B • Updated Nov 17, 2024 • 1.2k • 1

mradermacher/zephyr_7b_norobots-fp16-i1-GGUF

7B • Updated Nov 17, 2024 • 398

sequelbox/Llama3.1-70B-PlumChat

Text Generation • 71B • Updated Dec 4, 2024 • 41 •