Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,914

Base only

Active filters: 5-bit

MaziyarPanahi/Dirty-Shirley-Writer-v01-Uncensored-GGUF

Text Generation • 9B • Updated Mar 24, 2025 • 428 • 2

MaziyarPanahi/Dirty-Shirley-Writer-v0-abliterated-GGUF

Text Generation • 9B • Updated Mar 24, 2025 • 215 • 1

MaziyarPanahi/Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o-GGUF

Text Generation • 8B • Updated Mar 24, 2025 • 79 • 1

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • 9B • Updated Mar 24, 2025 • 48 • 1

remichu/Qwen2.5-VL-32B-Instruct-exl2-5.0bpw

Image-Text-to-Text • Updated Mar 27, 2025 • 8

Mawdistical/Feline-Clairvoyance-72B_EXL2_5.0bpw_H8

Updated Mar 29, 2025 • 11

Mawdistical/Wanton-Wolf-70B_EXL2_5.0bpw_H8

Updated Mar 30, 2025 • 7

Mawdistical/Draconic-Tease-70B_EXL2_5.0bpw_H8

Updated Apr 7, 2025 • 8

Dracones/QwQ-32B-ArliAI-RpR-v1_exl2_5.0bpw

Updated Apr 8, 2025 • 10

Mawdistical/Vulpine-Seduction-70B_EXL2_5.0bpw_H8

Updated Apr 9, 2025 • 9

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_5bpw_H8

Text Generation • Updated Apr 15, 2025 • 9

Uninformed/QwQ-32B-abliterated-exl2-5bpw-h8

Text Generation • Updated Apr 20, 2025 • 10

phires/Llama-3.2-1B-Instruct-GGUF-rk3588-1.1.2

Text Generation • Updated Apr 20, 2025 • 10

sleepdeprived3/Reformed-Christian-Bible-Expert-v2.1-12B_EXL2_5bpw_H8

Text Generation • Updated Apr 21, 2025 • 16

MaziyarPanahi/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated Apr 22, 2025 • 90 • 1

MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF

Text Generation • 4B • Updated Apr 21, 2025 • 123 • 1

MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF

Text Generation • 8B • Updated Apr 21, 2025 • 190 • 1

MaziyarPanahi/cogito-v1-preview-llama-70B-GGUF

Text Generation • 71B • Updated Apr 22, 2025 • 86 • 1

MetaphoricalCode/Omega-Darker_The-Final-Directive-24B_EXL2_5.0bpw_H8

Text Generation • Updated May 3, 2025 • 15

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 282k • 14

MaziyarPanahi/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 277k • 11

MaziyarPanahi/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 274k • 11

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 318k • 8

MaziyarPanahi/Qwen3-14B-GGUF

Text Generation • 15B • Updated Apr 28, 2025 • 279k • 11

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • 33B • Updated Apr 29, 2025 • 272k • 2

bullerwins/Qwen3-30B-A3B-exl2_5.0bpw

Text Generation • Updated May 5, 2025 • 20

MaziyarPanahi/INTELLECT-2-GGUF

Text Generation • 33B • Updated May 12, 2025 • 168k • 3

MetaphoricalCode/Star-Command-R-32B-v1-exl3-5bpw-hb6

12B • Updated May 12, 2025 • 8

MetaphoricalCode/Star-Command-R-Lite-32B-v1-exl3-5bpw-hb6

Text Generation • 12B • Updated May 13, 2025 • 10

ArtusDev/L3.3-Electra-R1-70b_EXL3_5.0bpw_H8

Text Generation • 23B • Updated May 13, 2025 • 15 • 1