Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,835

Base only

Active filters: quantization

Infatoshi/Qwen3.6-35B-A3B-NVFP4-FP8

Image-Text-to-Text • Updated Apr 17 • 1.19k • 3

AMAImedia/Qwen3-1.7B-TTS-Cross-Darwin-NOESIS-AWQ-INT4

Text-to-Speech • 2B • Updated Apr 26 • 22 • 14

AsadIsmail/SmolVLM2-500M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/SmolVLM2-256M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/whisper-medium-ternary

Automatic Speech Recognition • Updated Apr 17

AsadIsmail/whisper-small-ternary

Automatic Speech Recognition • Updated Apr 17

AsadIsmail/Wan2.1-T2V-1.3B-ternary

Text-to-Video • Updated Apr 20 • 30 • 1

AsadIsmail/Wan2.2-TI2V-5B-ternary

Text-to-Video • Updated Apr 20 • 3

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

Text Generation • 20B • Updated Apr 26 • 49 • 11

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT8

Text Generation • 37B • Updated Apr 26 • 46 • 11

jacob9706/Qwen3.6-35B-A3B-QOR-4bit

Text Generation • 5B • Updated Apr 18 • 36

mradermacher/Nero-Qwen2.5-1.5B-Surgical-GGUF

2B • Updated Apr 18 • 104

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

36B • Updated 17 days ago • 3.23k • 16

mradermacher/Nero-Qwen2.5-1.5B-Surgical-i1-GGUF

2B • Updated Apr 18 • 232

Venugopalan2610/OLMoE-1B-7B-0125-QTIP-2bit

7B • Updated Apr 18 • 46

catplusplus/MiniMax-M2.7-REAP-172B-A10B-NVFP4

Text Generation • 116B • Updated Apr 18 • 12 • 2

genevera/Qwen3.6-35B-A3B-Abliterated-Heretic-AWQ-4bit

Text Generation • 36B • Updated Apr 26 • 35.6k • 8

otavio-lemos/oci-copilot-jr-gguf

8B • Updated Apr 19 • 29

Sensen02/Fast_dVLM_3B_W8A8_FP8

4B • Updated Apr 19 • 9 • 1

Nishant2414/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 19 • 66 • 1

rayenhizaoui/Whisper-Rayen-Medical

Automatic Speech Recognition • 0.2B • Updated Apr 19 • 32 • 1

eschmidbauer/parakeet-unified-en-0.6b-c

Automatic Speech Recognition • Updated Apr 19 • 1

claroche1/sparse-nsnet2-checkpoints

Updated 27 days ago

brunogcp/Gemma4-26b-Super-Abliterated-TQ3_4S

Image-Text-to-Text • 25B • Updated Apr 20 • 22

SoybeanMilk/Breeze-ASR-26-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Apr 20 • 7

Krasnopjorovs/gemma-4-E4B-Imatrix-IQ4_XS-GGUF

Text Generation • 8B • Updated Apr 21 • 68

Reinforce-ai/spiral-qwen2.5-coder-7b

Text Generation • 8B • Updated Apr 22 • 5

vrfai/GR00T-N1.6-bridge-INT8-Edge

Robotics • 3B • Updated Apr 21 • 2 • 1

codeShare/FLUX.2-klein-AIO-SDNQ-4bit-dynamic

Text-to-Image • Updated May 10 • 16 • 3

haanjack/Solar-Open-100B-MXFP4

Text Generation • 57B • Updated Apr 22 • 51