Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,591

Base only

Active filters: quantized

batiai/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated May 3 • 6.78k • 11

drawais/Qwen3-Embedding-8B-AWQ-INT4

Text Generation • 8B • Updated May 3 • 179k • 4

calneymgp/parakeet-tdt-0.6b-v3-ptBR-TAGARELA-onnx-int8

Automatic Speech Recognition • Updated May 4 • 105 • 6

UDream/flux2-dev-turbo-Q4_K_M

32B • Updated May 5 • 628 • 11

kasimat/Qwen3.6-27B-AEON-Ultimate-Uncensored-FP8-MTP

Image-Text-to-Text • 28B • Updated May 6 • 64k • 20

drawais/Granite-4.1-30B-NVFP4

Text Generation • 16B • Updated May 6 • 412 • 1

OsaurusAI/ZAYA1-8B-MXFP4

Text Generation • 2B • Updated May 10 • 139 • 7

Radamanthys11/Gemma-4-26B-A4B-it-assistant-GGUF

0.4B • Updated May 10 • 745 • 4

kokoso/whisper-large-v3-turbo_pl

Automatic Speech Recognition • Updated May 7 • 4

OsaurusAI/ZAYA1-VL-8B-MXFP4

Image-Text-to-Text • 3B • Updated May 10 • 50 • 2

nvidia/Kimi-K2.6-NVFP4

Text Generation • Updated May 15 • 912k • 41

Jundot/Qwen3.6-27B-oQ6-fp16-mtp

7B • Updated May 12 • 531 • 5

Jundot/Qwen3.6-35B-A3B-oQ6-fp16-mtp

8B • Updated May 12 • 633 • 5

MLXBits/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated May 12 • 648 • 22

ssfdre38/gemma4-turbo-gguf

26B • Updated Jun 5 • 1.06k • 4

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 7B • Updated May 13 • 942 • 5

developerjeremylive/VibeVoice-1.5B-MLX-INT4-etheroi

Text-to-Speech • 0.8B • Updated May 16 • 43 • 1

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 460 • 3

mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 20.2k • 58

Incarnas/Qwen3.5-122B-A10B-NVFP4-MTP-GGUF

Image-Text-to-Text • 125B • Updated May 20 • 1.36k • 2

mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

36B • Updated May 21 • 5.88k • 19

natfii/Qwen3.6-27B-VLM-NVFP4-MTP

Image-Text-to-Text • 17B • Updated about 1 month ago • 3.26k • 6

nilayparikh/Qwen3.6-27B-Text-NVFP4-MTP-GGUF

Text Generation • Updated May 30 • 449 • 10

numind/NuExtract3-mlx-4bits

1.0B • Updated May 19 • 75 • 2

Abiray/Lance_3B_Video-GGUF

6B • Updated May 21 • 1.57k • 23

inferencerlabs/Qwen3.6-35B-A3B-MTP-MLX-Q4

Image-Text-to-Text • 0.1B • Updated 14 days ago • 545 • 1

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 922 • 39

inferencerlabs/DeepSeek-V4-Flash-MTP-MLX

Text Generation • 1B • Updated 14 days ago • 3.42k • 1

inferencerlabs/DeepSeek-V4-Pro-MTP-MLX

Text Generation • 4B • Updated 14 days ago • 5.42k • 2

dataslab/DSLM-LST-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 35B • Updated Jun 1 • 43 • 1