Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

729

Base only

Active filters: bf16

trjxter/Qwimi3.5-9B-Kimik2.6-Opus-Distill-MTP-BF16

Text Generation • 10B • Updated May 22 • 57 • • 2

Orionfold/patent-strategist-v3-nemo

Text Generation • 8B • Updated May 25 • 20

prithivMLmods/gemma-4-26B-A4B-Heretic-Stable

Any-to-Any • 26B • Updated Jun 1 • 12 • 1

adamroberts/tinystories-5090

Text Generation • 0.1B • Updated Jun 5 • 23

mradermacher/gemma-4-26B-A4B-Heretic-Stable-GGUF

25B • Updated May 23 • 383

mradermacher/gemma-4-26B-A4B-Heretic-Stable-i1-GGUF

25B • Updated May 23 • 634 • 1

Felldude/Ministral-3-8B-Uncensored

Image-to-Text • 9B • Updated May 25 • 79 • 4

Felldude/Ministral-3-8B-Uncensored-FP8

Image-to-Text • 9B • Updated May 25 • 407 • 5

torchsnow/Ministral-3-8B-Uncensored-Q5_K_S-GGUF

Image-to-Text • 8B • Updated May 23 • 413

trjxter/Qwimi3.5-9B-Kimik2.6-Opus-Distill-MLX-4Bit

Text Generation • 1B • Updated May 24 • 722 • 1

trjxter/Qwimi3.5-9B-Kimik2.6-Opus-Distill-MLX-6Bit

Text Generation • 9B • Updated May 24 • 483

trjxter/Qwimi3.5-9B-Kimik2.6-Opus-Distill-MLX-8Bit

Text Generation • 9B • Updated May 24 • 571

mradermacher/Ministral-3-8B-Uncensored-GGUF

8B • Updated May 24 • 227 • 1

mradermacher/Ministral-3-8B-Uncensored-i1-GGUF

8B • Updated May 24 • 134 • 1

mradermacher/tinystories-5090-GGUF

Text Generation • 0.1B • Updated May 26 • 108

Philip-MIT/SOLE-R1-8B

Image-Text-to-Text • 770k • Updated May 31 • 50 • 3

CCSSNE/Qwen3.6-35B-A3B-Abliterated-Heretic-BF16

Text Generation • 35B • Updated May 25 • 10 • 1

apxi/qwen3-5-0-8b-security-triage-v4-7-merged

Text Generation • 0.9B • Updated May 25 • 17

mlx-community/DeepSeek-V4-Flash-MTP-bf16

Text Generation • 1B • Updated Jun 1 • 1.61k • 1

prithivMLmods/Qwen3.5-9B-MTP-GGUF

Image-Text-to-Text • 9B • Updated Jun 1 • 2.95k • 5

prithivMLmods/Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated Jun 1 • 1.34k • 3

prithivMLmods/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated Jun 4 • 2.66k • 3

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jun 1 • 1.85k • 3

glyphsoftware/gemma-4-26b-a4b-opus-4.7-distilled-gguf

Text Generation • 25B • Updated May 30 • 7.26k

spinochenza/XORTRON.CriminalComputing.Config.LARGE.XPRT2

Text Generation • 125B • Updated May 29 • 7 • 1

AEON-7/Step-3.7-Flash-AEON-Ultimate-Abliterated-BF16

Image-Text-to-Text • 201B • Updated Jun 21 • 566 • 3

reaperdoesntknow/Gemma-3-270m-Opus-Distil

Text Generation • 0.3B • Updated about 5 hours ago • 2.16k • 1

prithivMLmods/Qwen3.5-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jun 1 • 318 • 1

prithivMLmods/Qwen3.5-2B-MTP-GGUF

Image-Text-to-Text • 2B • Updated Jun 1 • 403 • 1

mradermacher/Llama-3.1-8B-Instruct-TTS-Phonetic-Denglish-GGUF

Text-to-Speech • 8B • Updated May 31 • 78