Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,673

Base only

Active filters: chat

bartowski/turbcat-instruct-72b-GGUF

Text Generation • 73B • Updated Jul 22, 2024 • 481 • 2

pek111/llama-3-typhoon-v1.5-8b-instruct-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 507

mradermacher/turbcat-instruct-72b-GGUF

73B • Updated Jul 21, 2024 • 233

mradermacher/turbcat-instruct-72b-i1-GGUF

73B • Updated Aug 2, 2024 • 639 • 1

blockblockblock/turbcat-instruct-72b-bpw4.2-exl2

Text Generation • Updated Jul 21, 2024 • 4

QuantFactory/calme-2.8-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 22, 2024 • 117 • 1

ghost-x/ghost-8b-beta

Text Generation • 8B • Updated Aug 19, 2024 • 137 • • 14

elvispresniy/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jul 23, 2024 • 20

xsanskarx/qwen2-0.5b_numina_math-instruct

Text Generation • 0.5B • Updated Jul 23, 2024 • 7 •

mradermacher/ghost-8b-beta-GGUF

8B • Updated Jul 23, 2024 • 430 • 2

mradermacher/ghost-8b-beta-i1-GGUF

8B • Updated Aug 2, 2024 • 217 • 1

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • 8B • Updated Mar 12, 2025 • 22 • • 6

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Mar 19 • 40.8k • 9

MaziyarPanahi/calme-2.1-llama3.1-70b

Text Generation • 71B • Updated Oct 16, 2024 • 6 • 4

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated 12 days ago • 19.2k • 20

pashaprokaz/Qwen2-7B-Instruct

Text Generation • 8B • Updated Jul 24, 2024 • 3

pashaprokaz/Qwen2-72B-Instruct

Text Generation • 73B • Updated Jul 24, 2024 • 4

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 320 • 7

shareAI/llama3.1-8b-instruct-dpo-zh

Question Answering • 8B • Updated Jul 27, 2024 • 37 • 19

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 4

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 5

QuantFactory/ghost-8b-beta-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 218 • 1

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • 0.5B • Updated Jul 26, 2024 • 50

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated May 5 • 56.9k • 30

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jul 26, 2024 • 38

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 432

mradermacher/calme-2.1-llama3.1-70b-GGUF

71B • Updated Jul 28, 2024 • 101 • 1

msimou/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jul 28, 2024 • 55

anthracite-org/magnum-v1-32b

Text Generation • 33B • Updated Aug 29, 2024 • 10 • 27

anthracite-org/magnum-v1-32b-gguf

Text Generation • 33B • Updated Aug 22, 2024 • 134 • 19