Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,209

Base only

Active filters: chat

mradermacher/turbcat-instruct-72b-i1-GGUF

73B • Updated Aug 2, 2024 • 411 • 1

blockblockblock/turbcat-instruct-72b-bpw4.2-exl2

Text Generation • Updated Jul 21, 2024 • 3

QuantFactory/calme-2.8-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 22, 2024 • 251 • 1

ghost-x/ghost-8b-beta

Text Generation • 8B • Updated Aug 19, 2024 • 12 • • 14

elvispresniy/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jul 23, 2024 • 13

xsanskarx/qwen2-0.5b_numina_math-instruct

Text Generation • 0.5B • Updated Jul 23, 2024 • 29

mradermacher/ghost-8b-beta-GGUF

8B • Updated Jul 23, 2024 • 496 • 2

mradermacher/ghost-8b-beta-i1-GGUF

8B • Updated Aug 2, 2024 • 558 • 1

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • 8B • Updated Mar 12, 2025 • 25 • • 6

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated 22 days ago • 74.1k • 9

MaziyarPanahi/calme-2.1-llama3.1-70b

Text Generation • 71B • Updated Oct 16, 2024 • 3 • 4

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated 22 days ago • 19.9k • 20

pashaprokaz/Qwen2-7B-Instruct

Text Generation • 8B • Updated Jul 24, 2024 • 4

pashaprokaz/Qwen2-72B-Instruct

Text Generation • 73B • Updated Jul 24, 2024 • 10

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 267 • 7

shareAI/llama3.1-8b-instruct-dpo-zh

Question Answering • 8B • Updated Jul 27, 2024 • 93 • 19

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 6

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 6

QuantFactory/ghost-8b-beta-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 72 • 1

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • 0.5B • Updated Jul 26, 2024 • 26

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated 22 days ago • 81.6k • 30

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jul 26, 2024 • 4

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 166

mradermacher/calme-2.1-llama3.1-70b-GGUF

71B • Updated Jul 28, 2024 • 305 • 1

msimou/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jul 28, 2024 • 51

anthracite-org/magnum-v1-32b

Text Generation • 33B • Updated Aug 29, 2024 • 9 • 27

anthracite-org/magnum-v1-32b-gguf

Text Generation • 33B • Updated Aug 22, 2024 • 220 • 19

anthracite-org/magnum-v1-32b-exl2

Text Generation • Updated Jul 28, 2024 • 2 • 3

mradermacher/calme-2.1-llama3.1-70b-i1-GGUF

71B • Updated Aug 2, 2024 • 1.38k • 1

mradermacher/magnum-32b-v1-GGUF

33B • Updated Dec 16, 2024 • 204 • 1