Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,284

Base only

Active filters: 8-bit

mshojaei77/gpt-oss-120b

120B • Updated Aug 11, 2025 • 565 • 2

openbmb/MiniCPM-V-4_5-int4

Image-Text-to-Text • 9B • Updated Mar 10 • 4.29k • 16

nvidia/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Sep 15, 2025 • 279k • 13

nvidia/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Sep 9, 2025 • 182k • 21

shanjiaz/gpt-oss-120b-nvfp4-modelopt

59B • Updated Sep 24, 2025 • 1.83k • 5

lmstudio-community/Qwen3-VL-4B-Instruct-MLX-8bit

Image-Text-to-Text • 2B • Updated Oct 28, 2025 • 104k • 2

mlx-community/Qwen3-VL-32B-Thinking-8bit

Image-Text-to-Text • Updated Oct 21, 2025 • 35 • 1

RedHatAI/Llama-3.1-8B-Instruct-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 19.9k • 2

RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-NVFP4

Text Generation • 14B • Updated Dec 4, 2025 • 4.36k • 10

mlx-community/GLM-ASR-Nano-2512-8bit

Automatic Speech Recognition • 0.6B • Updated Dec 19, 2025 • 43 • 2

LiquidAI/LFM2.5-1.2B-Instruct-MLX-8bit

Text Generation • 0.3B • Updated Mar 30 • 758 • 20

lmstudio-community/LFM2.5-VL-1.6B-MLX-8bit

Image-Text-to-Text • 0.7B • Updated Jan 8 • 408 • 1

nvidia/Qwen3-Coder-480B-A35B-Instruct-NVFP4

Text Generation • 241B • Updated Feb 5 • 1.26k • 15

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 19 • 13

mlx-community/pocket-tts-8bit

Text-to-Speech • 44.6M • Updated Jan 20 • 39 • 4

mlx-community/Qwen3-TTS-12Hz-1.7B-CustomVoice-8bit

Text-to-Speech • 0.8B • Updated Jan 26 • 3.57k • 27

tzervas/qwen2.5-coder-14b-bitnet-1.58b

Text Generation • 4B • Updated Jan 29 • 6.28k • 5

mlx-community/Qwen3-ASR-1.7B-8bit

Updated Jan 29 • 2.98k • 14

cr0sh/Trinity-Mini-mlx-8Bit

Text Generation • 26B • Updated Feb 2 • 22 • 1

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated Feb 2 • 7.92k • 2

amd/Qwen3-Coder-Next-MXFP4

41B • Updated Feb 3 • 265 • 5

furiosa-ai/K-EXAONE-236B-A23B-NVFP4A16

Text Generation • 138B • Updated 6 days ago • 2.38k • 1

alexliap/Qwen3-Embedding-8B-NVFP4

Feature Extraction • 5B • Updated Feb 19 • 6.12k • 5

mlx-community/Qwen3.5-9B-8bit

Image-Text-to-Text • 3B • Updated Mar 2 • 9.6k • 17

AxionML/Qwen3.5-122B-A10B-NVFP4

Image-Text-to-Text • 62B • Updated Mar 3 • 251 • 7

lukey03/Qwen3.5-9B-abliterated-MLX-8bit

Text Generation • 9B • Updated Mar 3 • 793 • 12

FuriosaAIShareLGAI/K-EXAONE-236B-A23B-NVFP4A16

138B • Updated May 11 • 821 • 3

nvidia/gpt-oss-puzzle-88B

Text Generation • 91B • Updated Apr 28 • 405 • 93

p-e-w/gpt-oss-20b-heretic-ara-v4

Text Generation • 22B • Updated Apr 2 • 1.89k • 14

mlx-community/gemma-4-26b-a4b-it-8bit

Image-Text-to-Text • 8B • Updated 9 days ago • 3.85k • 14