Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,570

Base only

Active filters: instruct

mradermacher/Llama-3-portuguese-Tom-cat-8b-instruct-GGUF

8B • Updated Dec 18, 2024 • 28

mradermacher/Llama-3-portuguese-Tom-cat-8b-instruct-i1-GGUF

8B • Updated Dec 18, 2024 • 33

Satwik11/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit

Text Generation • 71B • Updated Jul 14, 2025 • 60

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v2

Text Generation • 33B • Updated Dec 18, 2024 • 12 • 16

numen-tech/Hermes-3-Llama-3.1-8B-w3a16g40sym

Text Generation • Updated Dec 18, 2024

numen-tech/Hermes-3-Llama-3.1-8B-w4a16g128asym

Text Generation • Updated Dec 18, 2024

mradermacher/BgGPT-7B-Instruct-v0.2-GGUF

7B • Updated Aug 1, 2025 • 24 • 1

mradermacher/BgGPT-7B-Instruct-v0.2-i1-GGUF

7B • Updated Dec 19, 2024 • 28 • 1

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

3B • Updated Dec 19, 2024 • 159 • 1

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v3

Text Generation • 33B • Updated Dec 20, 2024 • 10 • 14

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX

7B • Updated Dec 20, 2024 • 5

mradermacher/AlphaMonarch-dora-GGUF

7B • Updated Dec 20, 2024 • 58 • 1

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa

Text Generation • Updated Dec 20, 2024 • 19

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-0cb1b

0.7B • Updated Dec 20, 2024 • 4

mradermacher/AlphaMonarch-dora-i1-GGUF

7B • Updated Dec 20, 2024 • 34 • 1

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-104ce

0.9B • Updated Dec 20, 2024 • 5

tasksource/ModernBERT-base-nli

Zero-Shot Classification • 0.1B • Updated Jan 6, 2025 • 4.64k • • 29

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-196c8

1B • Updated Dec 20, 2024 • 6

NaniDAO/Llama-3.3-70B-Instruct-ablated

Text Generation • 71B • Updated Dec 20, 2024 • 32 • • 21

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa-8bit

Text Generation • Updated Dec 20, 2024 • 15

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-8777b

2B • Updated Dec 20, 2024 • 5

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa-4bit

Text Generation • Updated Dec 20, 2024 • 33

itlwas/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

8B • Updated Dec 20, 2024 • 21

itlwas/Hermes-2-Pro-Mistral-7B-Q4_K_M-GGUF

7B • Updated Dec 20, 2024 • 18

itlwas/Nous-Hermes-2-SOLAR-10.7B-Q4_K_M-GGUF

11B • Updated Dec 20, 2024 • 17

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-393a7

2B • Updated Dec 20, 2024 • 9

itlwas/Nous-Hermes-2-Yi-34B-Q4_K_M-GGUF

34B • Updated Dec 20, 2024 • 30

mradermacher/Llama-3.3-70B-Instruct-ablated-GGUF

71B • Updated Dec 21, 2024 • 81

mradermacher/Llama-3.3-70B-Instruct-ablated-i1-GGUF

71B • Updated Dec 21, 2024 • 116 • 1

bartowski/Llama-3.3-70B-Instruct-ablated-GGUF

Text Generation • 71B • Updated Dec 21, 2024 • 1.95k • 16