Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

495

Base only

Active filters: llm-compressor

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-code-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 6

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-math-code-science-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 10

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-chat-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 10

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-code-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 9

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-math-code-science-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 11

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-science-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 21

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-science-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 11

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-ultrachat-200k-train-sft-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 6

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 9

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 10

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-ultrachat-200k-train-sft-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 5

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-c4-en-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 7

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-codeforces-cots-solutions-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-openr1-math-220k-all-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 6

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-codeforces-cots-solutions-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-openr1-math-220k-all-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

IKilledBardia/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 20B • Updated Jul 9 • 154

amanwalksdownthestreet/DeepSeek-R1-Distill-Llama-70B-MXFP8

Text Generation • 73B • Updated Jul 13 • 17

jamiefutch/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4

Image-Text-to-Text • 74B • Updated Jul 14 • 275 • 3

RedHatAI/Inkling-FP8-dynamic

Image-Text-to-Text • 953B • Updated 19 days ago • 1.99k • 1

riclara/Ornith-1.0-9B-NVFP4

Image-Text-to-Text • 6B • Updated Jul 16 • 97

uist-labs/Qwen2.5-7B-Instruct-NVFP4A16

Text Generation • 8B • Updated 19 days ago • 320

hudsongouge/qwen35-4b-nvfp4-podcast-cleaner-grpo

Image-Text-to-Text • 3B • Updated Jul 16 • 11

hudsongouge/qwen35-9b-nvfp4-podcast-cleaner-grpo

Image-Text-to-Text • 7B • Updated Jul 16 • 11

RedHatAI/Inkling-FP8-block

Image-Text-to-Text • 952B • Updated 19 days ago • 117 • 1

sahilchachra/Qwythos-9B-v2-AWQ

Text Generation • 9B • Updated about 1 month ago • 1.09k • 2

juanginer/Voxtral-Mini-3B-2507-AWQ4-EN

Automatic Speech Recognition • 5B • Updated 28 days ago • 249 • 1

juanginer/Voxtral-Mini-3B-2507-AWQ4-ARG

Automatic Speech Recognition • 5B • Updated 28 days ago • 251

juanginer/Voxtral-Mini-3B-2507-AWQ4-GEN

Automatic Speech Recognition • 5B • Updated 28 days ago • 309 • 1