Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,513

Base only

Active filters: 6-bit

MaziyarPanahi/Qwen3-30B-A3B-Thinking-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 40

lmstudio-community/Olmo-3-7B-Instruct-MLX-6bit

7B • Updated Nov 20, 2025 • 40

lmstudio-community/Olmo-3-7B-Think-MLX-6bit

7B • Updated Nov 20, 2025 • 33

lmstudio-community/Olmo-3-32B-Think-MLX-6bit

32B • Updated Nov 20, 2025 • 31.5k

lmstudio-community/Olmo-3-1025-7B-MLX-6bit

7B • Updated Nov 20, 2025 • 28

lmstudio-community/Olmo-3-1125-32B-MLX-6bit

32B • Updated Nov 20, 2025 • 21

DeathGodlike/Chaos-Unknown-12b_EXL3

Text Generation • Updated Nov 20, 2025 • 3

mlx-community/Olmo-3-7B-Instruct-6bit

Text Generation • 7B • Updated Nov 20, 2025 • 12

mlx-community/Olmo-3-7B-Instruct-SFT-6bit

Text Generation • 7B • Updated Nov 20, 2025 • 7

mlx-community/Olmo-3-7B-RLZero-Mix-6bit

Text Generation • 7B • Updated Nov 21, 2025 • 14

mlx-community/Olmo-3-7B-Think-6bit

Text Generation • 7B • Updated Nov 21, 2025 • 8

garrison/Olmo-3-32B-Think-mlx-6Bit

32B • Updated Nov 21, 2025 • 11

mlx-community/Olmo-3-7B-Think-SFT-6bit

Text Generation • 7B • Updated Nov 21, 2025 • 11

mlx-community/Olmo-3-1025-7B-6bit

Text Generation • 7B • Updated Nov 21, 2025 • 12

mlx-community/Olmo-3-1125-32B-6bit

Text Generation • 32B • Updated Nov 21, 2025 • 17

Plurigrid/DR-Tulu-8B-MLX-6bit

8B • Updated Nov 22, 2025 • 6

garrison/Snowpiercer-15B-v4-mlx-6Bit

15B • Updated Nov 23, 2025 • 33

mlx-community/GLM-4.6-6bit

Text Generation • 353B • Updated Nov 23, 2025 • 13

DeathGodlike/Sunlit-Shadow-12B_EXL3

Text Generation • Updated Nov 23, 2025

DeathGodlike/Starfallen-Snow-Fantasy-24B-MS3.2-v0.0_EXL3

Text Generation • Updated Nov 24, 2025 • 3

DeathGodlike/Strawberry-Smoothie-12B-Model-Stock_EXL3

Text Generation • Updated Nov 24, 2025 • 1

garrison/GLM-4.5-Air-Derestricted-mlx-6Bit

Text Generation • 107B • Updated Nov 24, 2025 • 84 • 1

DeathGodlike/ThetaBlackGorgon-8B_EXL3

Text Generation • Updated Dec 7, 2025 • 1

mlx-community/Josiefied-Olmo-3-7B-Instruct-abliterated-v1-6bit

Text Generation • 7B • Updated Nov 25, 2025 • 8

mlx-community/Olmo-3-7B-RLZero-Code-6bit

Text Generation • 7B • Updated Nov 25, 2025 • 9

DeathGodlike/LemonadeRP-4.5.3_EXL3

Text Generation • Updated Nov 26, 2025 • 3

mlx-community/LLaDA2.0-mini-6bit

Text Generation • 16B • Updated Nov 26, 2025 • 16

mlx-community/LLaDA2.0-flash-6bit

Text Generation • 103B • Updated Nov 26, 2025 • 20

DeathGodlike/WinterEngine-24B-Instruct_EXL3

Text Generation • Updated Nov 26, 2025

DeathGodlike/Scarlet-Seraph-12B_EXL3

Text Generation • Updated Nov 26, 2025