Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,354

Base only

Active filters: quantization

ujjwal52/Llama-2-7b-FLASH-UK

Text Generation • 7B • Updated Nov 22, 2025 • 15 • 1

varunpruthviraj/qwen3-8b-lora-merged

Text Generation • 8B • Updated Nov 23, 2025 • 15

EricRollei/HunyuanImage-3-NF4-ComfyUI

Text-to-Image • 83B • Updated Nov 24, 2025 • 160 • 5

huawei-csl/Kimi-Linear-48B-A3B-Instruct-4bit-SINQ

Text Generation • 27B • Updated Feb 2 • 29 • 3

huawei-csl/Qwen3-Next-80B-A3B-Instruct-4bit-SINQ

Text Generation • Updated Feb 2 • 21 • 2

huawei-csl/Kimi-Linear-48B-A3B-Instruct-3bit-SINQ

Text Generation • 7B • Updated Feb 2 • 35 • 1

huawei-csl/Qwen3-Next-80B-A3B-Instruct-3bit-SINQ

Text Generation • Updated Feb 2 • 22 • 2

ryandono/osgrep-coderank-q8

Feature Extraction • Updated Nov 24, 2025 • 18

ryandono/osgrep-colbert-q8

Feature Extraction • Updated Nov 24, 2025 • 16 • 1

ryandono/osgrep-coderank-q4

Feature Extraction • Updated Nov 24, 2025 • 20

AXONVERTEX-AI-RESEARCH/Fara-7B-Q8-GGUF

Image-Text-to-Text • 8B • Updated Nov 25, 2025 • 49 • 3

drbaph/Z-Image-Turbo-FP8

Text-to-Image • Updated Nov 27, 2025 • 12.3k • 54

EricRollei/Hunyuan_Image_3_Int8

Text-to-Image • 83B • Updated Nov 27, 2025 • 11 • 3

AlekseyCalvin/FLUX2_dev_2bit_hqq

Image-to-Image • 9B • Updated Nov 27, 2025 • 28 • 5

ogulcanakca/faster-whisper-small-tr

Automatic Speech Recognition • Updated Nov 30, 2025 • 77 • 5

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated Dec 18, 2025 • 13 • 3

avtc/MiniMax-M2-GPTQMODEL-W4A16

Text Generation • 229B • Updated Nov 30, 2025 • 18

gia-uh/cecilia-2b-instruct-v1-GGUF

Text Generation • 2B • Updated Nov 29, 2025 • 25

Tfloow/llama-3.1-8B-adpq-4bit-sim

8B • Updated Dec 2, 2025 • 3

sevri/Apertus-8B-Instruct-2509-W8A8

8B • Updated Dec 6, 2025 • 17

avtc/GLM-4.5-Air-GPTQMODEL-W8A16

Text Generation • 116B • Updated Dec 1, 2025 • 18 • 2

ikarius/Qwen2.5-Coder-32B-Instruct-Abliterated-NF4

33B • Updated Dec 1, 2025 • 12 • 1

Hunjun/yolo-tank-detection

Object Detection • Updated Dec 1, 2025 • 1

HAD653/qwen3-1.7b-magistral-math-gguf

Text Generation • 2B • Updated Dec 4, 2025 • 1.03k • 1

Tfloow/Llama-3.2-1B-adpq-4bit-sim

1B • Updated Dec 13, 2025 • 12

Silan10/flux-quantized-bitsandbytes

Text-to-Image • 12B • Updated Feb 8 • 2

Tfloow/Meta-Llama-3.1-8B-adpq-4bit-sim

8B • Updated Dec 13, 2025 • 13

sevri/Apertus-8B-Instruct-2509-W8A8-CALIBRATED

8B • Updated Dec 6, 2025 • 16

jgerster0/Apertus-8B-Instruct-2509-bnb-8bit

8B • Updated Dec 2, 2025 • 17

SkyAsl/Rust-Master-thinking

Text Generation • 15B • Updated Dec 6, 2025 • 17