Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: affine

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-6bit-mlx

Text Generation • Updated Sep 15, 2025 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-8bit-mlx

Text Generation • Updated Sep 15, 2025

carlorrr/affine-0004-improved

Text Generation • 4B • Updated Oct 30, 2025 • 2

lyraresearchlabs/Affine-S3-GAME

Reinforcement Learning • 4B • Updated Dec 29, 2025 • 2

james-unicorn/affine-train-1

Text Generation • 4B • Updated Jan 26 • 3

james-unicorn/affine-2-5C5iKrLBTwNTuQdC1VB54tbjHVidxyjkh49AcYJ3zgqtkqgH

Text Generation • 4B • Updated Jan 27 • 3

rautaditya/Qwen3-4B-Instruct-MLX-4bit

Text Generation • 0.6B • Updated Mar 28 • 8

Deviad/DeepSeek-V4-Flash-MLX-Q4Q8

Text Generation • 56B • Updated Apr 29 • 452

osmapi/DeepSeek-V4-Flash-5bit-mlx

Text Generation • 53B • Updated May 17 • 481

osmapi/DeepSeek-V4-Flash-6bit-mlx

Text Generation • 62B • Updated May 17 • 520

ekryski/SmolLM2-360M-Instruct-4bit

96.4M • Updated May 27 • 20

ekryski/Soprano-1.1-80M-4bit

24.7M • Updated May 27 • 1

ekryski/Nemotron-H-4B-Base-8K-4bit

1B • Updated May 27 • 37

ekryski/FastVLM-0.5B-4bit

0.3B • Updated May 27 • 37

ekryski/Qwen3.5-0.8B-2bit

0.4B • Updated May 26 • 32

majentik/MERaLiON-3-3B-ASR-MLX-8bit

Automatic Speech Recognition • 1B • Updated 13 days ago • 24

ekryski/SmolLM-360M-Instruct-4bit

96.4M • Updated May 27 • 3

ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

3B • Updated May 27 • 127 • 1

ekryski/OLMo-2-0425-1B-Instruct-4bit

0.6B • Updated May 27 • 39

ekryski/starcoder2-3b-4bit

0.6B • Updated May 27 • 60

ekryski/granite-3.0-2b-instruct-4bit

0.6B • Updated May 27 • 12 • 1

ekryski/internlm2-chat-1_8b-4bit

0.5B • Updated May 27 • 9

ekryski/Nemotron-Nano-12B-v2-VL-4bit

4B • Updated May 28 • 61

ekryski/fish-audio-s2-pro-4bit

1B • Updated May 27 • 83

ekryski/diar_streaming_sortformer_4spk-v2.1-4bit

30.2M • Updated May 27 • 2

osmapi/Step-3.7-Flash-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 30B • Updated Jun 1 • 592 • 3

ekryski/LFM2-8B-A1B-4bit

1B • Updated May 30 • 8

ekryski/LFM2.5-8B-A1B-4bit

2B • Updated May 30 • 23

ekryski/gemma-4-12B-it-mlx-4bit

3B • Updated Jun 4 • 56 • 1

ekryski/gemma-4-12B-it-assistant-mlx-4bit

0.3B • Updated Jun 3 • 49