Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

329

Base only

Active filters: turboquant

lemuralabs/DeepSeek-V4-Flash-TQ-Q5.6-MLX

Text Generation • 51B • Updated 12 days ago • 1.35k

lemuralabs/DeepSeek-V4-Flash-TQ-Q2.3-MLX

Text Generation • 22B • Updated 12 days ago • 993

YTan2000/Qwopus3.6-27B-v2-TQ3_4S

Image-Text-to-Text • 27B • Updated May 23 • 100 • 13

manjunathshiva/Qwen3.6-35B-A3B-tq3-g32

Text Generation • 37B • Updated Jul 16 • 165

manjunathshiva/Qwen3-235B-A22B-Instruct-2507-tq3a-tq2e-g32

Text Generation • 23B • Updated Jul 16 • 257

manjunathshiva/Qwen3-235B-A22B-Instruct-2507-tq3-g32

Text Generation • 31B • Updated Jul 16 • 216

manjunathshiva/Qwen3.6-27B-tq3-g32

Text Generation • 5B • Updated Jul 16 • 126

Phil2Sat/gemma-4-31B-it-assistant-GGUF

Text Generation • 0.5B • Updated Jun 4 • 58

ArithaAI/aritha-ai-mini

Updated Jun 6 • 1

bearcove/zipa-large-crctc-ns-no-diacritics-780k-tq4

Automatic Speech Recognition • 0.2B • Updated Jun 9 • 3

bearcove/g2p-multilingual-byT5-small-100-tq6

Text Generation • 0.3B • Updated Jun 9 • 7

bearcove/qwen3-asr-forced-aligner-0.6b-tq4_1s-text-tq4_1s-audio

0.6B • Updated Jun 9 • 4

robertolofaro/articlesextended-model

Text Generation • Updated Jun 11

manjunathshiva/diffusiongemma-26B-A4B-it-tq3-g32

Image-Text-to-Text • 5B • Updated Jul 16 • 79

bearzi/Kimi-K2.7-Code-JANGTQ_K

Text Generation • 89B • Updated Jun 13 • 912 • 1

MidnightPhreaker/Qwen3.6-27B-MTP-TQ4_1S-GGUF

Text Generation • 27B • Updated Jun 13 • 26

thetom-ai/MiniMax-M3-ConfigI-MLX

Text Generation • 49B • Updated Jun 16 • 208

thetom-ai/Spurgeon-Gemma-4-12B-v1

Text Generation • 12B • Updated Jun 15 • 15

bearzi/GLM-5.2-JANGTQ_K

Text Generation • 79B • Updated Jun 17 • 560 • 3

bearzi/GLM-5.2-JANGTQ4

Text Generation • 109B • Updated Jun 17 • 328 • 1

bearzi/GLM-5.2-JANGTQ

Text Generation • 64B • Updated Jun 17 • 572 • 3

Olafangensan/Gemma4-Gutenberg-31B-Heretic_tq3_1s.gguf

31B • Updated Jun 18 • 10

YTan2000/Qwen3.6-27B-MTP-TQ3_4S

Text Generation • 27B • Updated Jun 18 • 234 • 23

YTan2000/Qwen3.6-27B-MTP-TQ3_4S-mmproj

0.5B • Updated Jun 18 • 205

YTan2000/Ornith-1.0-35B-TQ3_4S

Image-Text-to-Text • 35B • Updated Jun 30 • 486 • 12

simonlesaumon/qwen-speedlab

Text Generation • Updated Jun 29

thetom-ai/Nemotron-H-8B-Base-8K-Config-I-GGUF

8B • Updated Jul 3 • 30

manjunathshiva/Qwen3.6-35B-A3B-tq3a-tqTe-g64

Text Generation • 29B • Updated Jul 16 • 590 • 2

thetom-ai/Nemotron-TheHobbit-30B-A3B

Updated Jul 3 • 13 • 2

manjunathshiva/Qwen3.5-122B-A10B-tq3a-tqTe-g64

Text Generation • 100B • Updated Jul 16 • 531 • 3