Models

5,990

Full-text search

Active filters: compressed-tensors

warshanks/Dolphin-Mistral-24B-Venice-Edition-AWQ

4B • Updated Jul 17, 2025 • 679 • 4

ByteDance-Seed/Seed-X-PPO-7B-GPTQ-Int8

Translation • 8B • Updated Jul 28, 2025 • 543 • 10

ByteDance-Seed/Seed-X-PPO-7B-AWQ-Int4

Translation • 1B • Updated Jul 28, 2025 • 112 • 11

NousResearch/Hermes-4-405B-FP8

Text Generation • Updated Sep 2, 2025 • 244 • 27

NousResearch/Hermes-4-70B-FP8

Text Generation • 71B • Updated Sep 12, 2025 • 1.46k • 28

NousResearch/Hermes-4-14B-FP8

Text Generation • 15B • Updated Sep 3, 2025 • 4.29k • 21

cyankiwi/Hermes-4-14B-AWQ-4bit

Text Generation • 4B • Updated Sep 4, 2025 • 29.2k • 4

cyankiwi/Qwen3-Omni-30B-A3B-Thinking-AWQ-4bit

Any-to-Any • 6B • Updated Sep 28, 2025 • 9.31k • 8

cyankiwi/Qwen3-Omni-30B-A3B-Captioner-AWQ-4bit

Any-to-Any • 6B • Updated Oct 1, 2025 • 935 • 7

nm-testing/Qwen3-VL-8B-Instruct-NVFP4

6B • Updated Oct 17, 2025 • 29k • 3

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-NVFP4

Text Generation • 229B • Updated Dec 9, 2025 • 216 • 6

moonshotai/Kimi-K2-Thinking

Text Generation • 1.1T • Updated Jan 30 • 132k • • 1.7k

xiezhe24/ChatTS-8B-GPTQ-Int4

Text Generation • 2B • Updated Dec 29, 2025 • 129 • 3

unsloth/Llama-3.2-3B-FP8-Block

Text Generation • 3B • Updated Nov 20, 2025 • 42 • 1

jiangchengchengNLP/qwen3-4b-fp8-scaled

Updated Nov 28, 2025 • 32 • 25

Firworks/Hermes-4.3-36B-nvfp4

21B • Updated Dec 5, 2025 • 1.93k • 5

cyankiwi/GLM-4.7-Flash-AWQ-4bit

Text Generation • 32B • Updated Mar 23 • 710k • 51

cyankiwi/GLM-4.7-Flash-REAP-23B-A3B-AWQ-4bit

Text Generation • 5B • Updated Jan 25 • 1.98k • 4

GadflyII/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 4 • 14.3k • 42

RedHatAI/Llama-Guard-4-12B-quantized.w8a8

12B • Updated Feb 16 • 24 • 1

Forturne/Qwen3-Embedding-0.6B-INT4-AWQ

0.4B • Updated Feb 11 • 47 • 1

mratsim/MiniMax-M2.5-BF16-INT4-AWQ

Text Generation • 39B • Updated Feb 17 • 10.6k • 38

alexliap/Qwen3-Embedding-8B-NVFP4

Feature Extraction • 5B • Updated Feb 19 • 5.91k • 2

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 15k • 26

cyankiwi/Qwen3.5-27B-AWQ-BF16-INT8

Image-Text-to-Text • 28B • Updated Mar 27 • 4.95k • 9

Sehyo/Qwen3.5-35B-A3B-NVFP4

Updated Mar 2 • 36k • 39

apolo13x/Qwen3.5-35B-A3B-NVFP4

Image-Text-to-Text • Updated Feb 27 • 31.1k • 15

cyankiwi/Qwen3.5-9B-AWQ-4bit

Image-Text-to-Text • 10B • Updated Mar 29 • 278k • 24

inference-optimization/gpt-oss-20b-FP8-Dynamic

21B • Updated Mar 5 • 8 • 1

carlyou/DeepSeek-Coder-V2-Lite-Instruct-NVFP4

9B • Updated Mar 16 • 17 • 1