Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

mixed-precision

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

612

Base only

Active filters: mixed-precision

AvoCahDoe/gemma-2-9b-rlmpq-high-fidelity

Text Generation • 9B • Updated Jun 11 • 6

deucebucket/Qwen3.6-35B-A3B-Heretic-Cerebellum-GGUF

Image-Text-to-Text • 35B • Updated 29 days ago • 2.18k • 5

AvoCahDoe/qwen2-5-7b-rlmpq-aggressive

Text Generation • 8B • Updated Jun 11 • 8

AvoCahDoe/qwen2-5-7b-rlmpq-balanced

Text Generation • 8B • Updated Jun 11 • 9

AvoCahDoe/qwen2-5-7b-rlmpq-conservative

Text Generation • 8B • Updated Jun 11 • 8

AvoCahDoe/qwen2-5-7b-rlmpq-extreme-survival

Text Generation • 8B • Updated Jun 11 • 8

AvoCahDoe/qwen2-5-7b-rlmpq-high-fidelity

Text Generation • 8B • Updated Jun 11 • 7

deucebucket/Qwen3.6-27B-Heretic-Cerebellum-GGUF

Image-Text-to-Text • 27B • Updated Jun 22 • 292 • 2

deucebucket/Gemma-4-E4B-it-Heretic-Cerebellum-GGUF

Text Generation • 8B • Updated Jun 14 • 84 • 3

JasonW2025/Qwopus3.6-35B-A3B-v1-PrismaQuant-5.06bit-vllm

23B • Updated Jun 12 • 90

sh111111111111111/Qwen3.5-9B-BitClass3-GGUF

Text Generation • 9B • Updated Jun 15 • 76

sh111111111111111/Qwen3-4B-Instruct-2507-BitClass3-GGUF

Text Generation • 4B • Updated Jun 15 • 78

sh111111111111111/Qwen3.5-4B-BitClass3-GGUF

Text Generation • 4B • Updated Jun 15 • 95

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated 14 days ago • 1.85k • 6

cspenn/Qwen3.6-35B-A3B-MLX-Mixed-4-8

Text Generation • 35B • Updated Jun 12 • 38

cspenn/Skyfall-31B-v4.2-MLX-Mixed-4-8

Text Generation • 31B • Updated Jun 12 • 334

JasonW2025/Qwopus3.6-35B-A3B-v1-PrismaQuant-5.06bit-MXFP6mix-vllm

24B • Updated about 1 month ago • 10

sahilchachra/supra-50m-instruct-optiq-5bpw-mlx

11.3M • Updated Jun 12 • 25 • 1

AvoCahDoe/llama-3-1-8b-rlmpq-aggressive

Text Generation • 8B • Updated Jun 12 • 8

AvoCahDoe/llama-3-1-8b-rlmpq-balanced

Text Generation • 8B • Updated Jun 12 • 7

AvoCahDoe/llama-3-1-8b-rlmpq-conservative

Text Generation • 8B • Updated Jun 12 • 7

AvoCahDoe/llama-3-1-8b-rlmpq-extreme-survival

Text Generation • 8B • Updated Jun 12 • 6

AvoCahDoe/llama-3-1-8b-rlmpq-high-fidelity

Text Generation • 8B • Updated Jun 12 • 6

AvoCahDoe/jetmoe-8b-rlmpq-aggressive

Text Generation • 9B • Updated Jun 12 • 14

AvoCahDoe/jetmoe-8b-rlmpq-balanced

Text Generation • 9B • Updated Jun 12 • 9

AvoCahDoe/jetmoe-8b-rlmpq-conservative

Text Generation • 9B • Updated Jun 12 • 9

AvoCahDoe/jetmoe-8b-rlmpq-extreme-survival

Text Generation • 9B • Updated Jun 12 • 10

AvoCahDoe/jetmoe-8b-rlmpq-high-fidelity

Text Generation • 9B • Updated Jun 12 • 7

deucebucket/North-Mini-Code-Cerebellum-GGUF

Text Generation • 30B • Updated Jun 14 • 87 • 2

EmanuelOverride/Melody1437-26B-A4B-v2.0-APEX-GGUF

25B • Updated 12 days ago • 5.78k • 2