Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

729

Base only

Active filters: bf16

FazeFlynn/my-350M-LLM

Text Generation • Updated Jun 19

prithivMLmods/Qwen3.5-0.8B-MTP-GGUF

Image-Text-to-Text • 0.8B • Updated Jun 1 • 1.15k • 2

notSnix/Step-3.7-Flash-Q4_K_M-MTP-GGUF

Text Generation • 197B • Updated Jun 3 • 504 • 13

ibrahimkettaneh/Step-3.7-Flash-uncensored-abliterated-heretic-BF16

Image-Text-to-Text • 201B • Updated Jun 23 • 17 • 7

AI-KSK/flux2-distilled-8step-comfyui-bf16-fp8mixed

Image-to-Image • Updated Jun 1 • 2

mlx-community/Qwen3.5-4B-MTP-bf16

Text Generation • 0.1B • Updated Jun 1 • 128 • 1

mlx-community/Qwen3.5-9B-MTP-bf16

Text Generation • 0.2B • Updated Jun 1 • 345 • 1

mlx-community/Qwen3.6-27B-MTP-bf16

Text Generation • 0.4B • Updated Jun 1 • 1.41k • 2

mlx-community/Qwen3.6-35B-A3B-MTP-bf16

Text Generation • 0.8B • Updated Jun 1 • 745

glebkudr/Infinity-Parser2-Pro-Q8-GGUF

35B • Updated Jun 2 • 4.15k • 1

SingularityPrinciple/Gemma-E2B-IT-10M-Chat

Updated Jun 10 • 1

prithivMLmods/Qwen3.5-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated Jun 2 • 409 • 1

mlx-community/Hy-MT2-1.8B-Abliterated-bf16

Translation • 2B • Updated Jun 2 • 38

mlx-community/Hy-MT2-7B-Abliterated-bf16

Translation • 8B • Updated Jun 2 • 58 • 1

JSchneemann/Mellum2-12B-A2.5B-Thinking-GGUF

Text Generation • 12B • Updated Jun 3 • 172 • 4

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated Jun 2 • 9.91k • 12

AbstractFramework/wan2.2-t2v-a14b-diffusers-bf16

Text-to-Video • Updated Jun 4

notSnix/Step-3.7-Flash-MTP-Draft-GGUF

3B • Updated Jun 3 • 767 • 4

fiorelorenzo/parakeet-tdt-0.6b-v3-mlx-bf16

Automatic Speech Recognition • 0.6B • Updated Jun 3 • 54

drbaph/WavTTS

Text-to-Speech • Updated Jun 4 • 2

AbstractFramework/wan2.2-i2v-a14b-diffusers-bf16

Image-to-Video • Updated Jun 4

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-BF16

Text Generation • 12B • Updated 20 days ago • 1.46k • 30

AbstractFramework/wan2.2-ti2v-5b-diffusers-bf16

Text-to-Video • Updated Jun 4

aufklarer/Nemotron-3.5-ASR-Streaming-0.6B-MLX-bf16

Automatic Speech Recognition • 0.6B • Updated Jun 4 • 45 • 3

edan23/Gemma-4-12B-it-AEON-Abliterated-K4-BF16

Text Generation • 12B • Updated Jun 5 • 10

poolside/Laguna-M.1-base

Text Generation • 226B • Updated 21 days ago • 417 • 14

adamroberts/tinystories-5090-sdprelu

Text Generation • 0.1B • Updated Jun 5 • 7

mradermacher/Gemma-4-12B-it-AEON-Abliterated-K4-BF16-GGUF

Text Generation • 12B • Updated Jun 23 • 997 • 1

drbaph/dots.tts-soar-bf16

Text-to-Speech • Updated Jun 6 • 1

drbaph/dots.tts-base-bf16

Text-to-Speech • Updated Jun 6 • 1