Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,957

Full-text search

Active filters: 3-bit

MaziyarPanahi/Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o-GGUF

Text Generation • 8B • Updated Mar 24, 2025 • 91 • 1

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • 9B • Updated Mar 24, 2025 • 18 • 1

Mawdistical/Feline-Clairvoyance-72B_EXL2_3.0bpw_H8

Updated Mar 29, 2025

Mawdistical/Wanton-Wolf-70B_EXL2_3.0bpw_H8

Updated Mar 30, 2025 • 1

cnfusion/QwQ-coder-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 30, 2025 • 6

alexgusevski/openhands-lm-32b-v0.1-mlx-3Bit

Text Generation • 4B • Updated Mar 31, 2025 • 1

tomasmcm/QwQ-Coder-R1-Distill-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 2, 2025 • 5

tomasmcm/QwQ-R1-Distill-Merge-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 2, 2025 • 3

alexgusevski/Synthia-S1-27b-mlx-3Bit

Image-Text-to-Text • 4B • Updated Apr 4, 2025 • 1

alexgusevski/OpenThinker2-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 5, 2025 • 9

Beridar/ReadyArt-Gaslit-Transgression-24B-v1.0-mlx-3bit

Text Generation • 3B • Updated Apr 6, 2025 • 7

Beridar/ReadyArt-Forgotten-Abomination-36B-v4.1-mlx-3bit

Text Generation • 5B • Updated Apr 6, 2025 • 11

Mawdistical/Draconic-Tease-70B_EXL2_3.0bpw_H8

Updated Apr 7, 2025

steve329/llama2-7B-gptq-3bits-c4-20GB-20GB

Text Generation • 6B • Updated Apr 7, 2025 • 1

Mawdistical/Vulpine-Seduction-70B_EXL2_3.0bpw_H8

Updated Apr 9, 2025 • 1

Serione/Llama-3.2-1B-SRLQ-3bit

Updated Apr 9, 2025

pleasen/phi-4-mlx-3Bit

Text Generation • 2B • Updated Apr 9, 2025 • 2

cnfusion/cogito-v1-preview-qwen-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 10, 2025 • 4

TendernessChen/PromptCoT-QwQ-32B-mlx-3Bit

4B • Updated Apr 11, 2025 • 14

Jellon/Pantheon-RP-1.8-24b-Small-3.1-exl3-3bpw

5B • Updated Apr 12, 2025 • 1 • 1

numen-tech/cogito-v1-preview-llama-70B-w3a16g40sym

Text Generation • Updated Apr 14, 2025

numen-tech/Llama-3.1-8B-UltraMedical-w3a16g40sym

Text Generation • Updated Apr 15, 2025

numen-tech/Medical-Llama3-v2-w3a16g40sym

Text Generation • Updated Apr 15, 2025

numen-tech/Meta-Llama-3.1-8B-SurviveV3-w3a16g40sym

Text Generation • Updated Apr 15, 2025

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_3bpw_H8

Text Generation • Updated Apr 15, 2025

YuHaaa/Qwen1.5-110B-Chat-mlx-3Bit

Text Generation • 14B • Updated Apr 17, 2025 • 12 • 1

phires/Llama-3.2-1B-Instruct-GGUF-rk3588-1.1.2

Text Generation • Updated Apr 20, 2025

MaziyarPanahi/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated Apr 22, 2025 • 54 • 1

MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF

Text Generation • 4B • Updated Apr 21, 2025 • 3 • 1

MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF

Text Generation • 8B • Updated Apr 21, 2025 • 4 • 1