Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,570

Base only

Active filters: instruct

tensorblock/Hermes-2-Theta-Llama-3-8B-32k-GGUF

8B • Updated Jan 27 • 19

tensorblock/Llama-3.3-70B-Instruct-ablated-GGUF

71B • Updated Jan 27 • 18

tensorblock/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Text Generation • 9B • Updated Jan 27 • 20

mradermacher/Llama-2-7b-dolphin-open_platypus-pruned_50-GGUF

7B • Updated Apr 10, 2025 • 21

tensorblock/Mistral-Small-Instruct-2409-abliterated-GGUF

Text Generation • 22B • Updated Jan 27 • 6

QuantFactory/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • 4B • Updated Jan 3, 2025 • 227 • 2

tasksource/ModernBERT-large-nli

Zero-Shot Classification • 0.4B • Updated Jan 4, 2025 • 4.11k • • 11

mradermacher/Llama-2-7b-dolphin-open_platypus-GGUF

7B • Updated Apr 10, 2025 • 8

itlwas/Gistral-16B-Q4_K_M-GGUF

Text Generation • 17B • Updated Jan 4, 2025 • 5

mradermacher/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Jan 5, 2025 • 133

mradermacher/Llama3-OpenBioLLM-8B-i1-GGUF

8B • Updated Jan 5, 2025 • 100 • 1

mrcuddle/Dark-Hermes3-Llama3.2-3B

Text Generation • Updated Jan 31, 2025 • 17 • 2

Melvin56/Hermes-3-Llama-3.2-3B-abliterated-Q4_0-GGUF

3B • Updated Jan 9, 2025 • 78 • 1

Melvin56/Hermes-3-Llama-3.2-3B-abliterated-Q8_0-GGUF

3B • Updated Jan 9, 2025 • 42 • 2

tensorblock/HelpSteer-filtered-7B-GGUF

7B • Updated Jan 27 • 4

mrcuddle/DarkHermes3-Llama3.2-3B-Instruct

Text Generation • 3B • Updated Jan 19, 2025 • 2 • 1

mradermacher/DarkHermes3-Llama3.2-3B-Instruct-GGUF

4B • Updated Jan 12, 2025 • 13 • 1

mradermacher/DarkHermes3-Llama3.2-3B-Instruct-i1-GGUF

4B • Updated Jan 12, 2025 • 17 • 1

mradermacher/Dark-Hermes3-Llama3.2-3B-GGUF

4B • Updated Jul 31, 2025 • 78 • 2

Maveth/Hermes-3-Llama-3.1-405B-rk3588-1.1.2

Text Generation • Updated Jan 13, 2025 • 3

mradermacher/boana-7b-instruct-GGUF

7B • Updated Jan 13, 2025 • 8

mradermacher/boana-7b-instruct-i1-GGUF

7B • Updated Jan 13, 2025 • 81

mradermacher/Dark-Hermes3-Llama3.2-3B-i1-GGUF

4B • Updated Jan 14, 2025 • 91 • 1

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jan 15, 2025 • 28 • 1

Nekuromento/Lily-Cybersecurity-7B-v0.2-Q8_0-GGUF

7B • Updated Jan 15, 2025 • 9

Nekuromento/Lily-Cybersecurity-7B-v0.2-Q6_K-GGUF

7B • Updated Jan 15, 2025 • 17

Nekuromento/Lily-Cybersecurity-7B-v0.2-Q5_K_M-GGUF

7B • Updated Jan 15, 2025 • 9 • 1

Nekuromento/Lily-Cybersecurity-7B-v0.2-Q4_K_M-GGUF

7B • Updated Jan 16, 2025 • 47 • 1

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-w4a16

Text Generation • 0.5B • Updated Oct 19, 2025 • 25 • 1

Ameer-linnk/Qwen2.5-7b-instruct-sft

8B • Updated Jan 17, 2025