Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

252

Full-text search

Active filters: int4

Ishant86/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-compressed-tensors-int4

6B • Updated Nov 13, 2025

zandzpider/Qwen3-30B-A3B-abliterated-erotic-autoround-int4

0.6B • Updated Nov 27, 2025 • 81

ikarius/Granite-3.2-8b-instruct-Abliterated-gs128-GPTQ-INT4

Text Generation • 8B • Updated Nov 18, 2025 • 3 • 1

huawei-csl/Kimi-Linear-48B-A3B-Instruct-4bit-SINQ

Text Generation • 27B • Updated 29 days ago • 21 • 3

huawei-csl/Qwen3-Next-80B-A3B-Instruct-4bit-SINQ

Text Generation • Updated 29 days ago • 91 • 2

Saktsant/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16

Text Generation • 2B • Updated Dec 23, 2025

CgrHello/mai-models

TevunahAi/granite-34b-code-instruct-8k-Ultra-Hybrid

Text Generation • 11B • Updated Dec 1, 2025 • 2

TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid

Text Generation • 22B • Updated Dec 4, 2025 • 1

M-Ziyo/tiny-random-MiniCPM-o-2_6-6mb

Updated Dec 8, 2025

jrc2139/granite-embedding-reranker-english-r2-ONNX

Text Classification • Updated Jan 16 • 1

jrc2139/granite-embedding-small-english-r2-ONNX

Feature Extraction • Updated 25 days ago • 5

jrc2139/granite-embedding-english-r2-ONNX

Feature Extraction • Updated 25 days ago • 10 • 1

superjob/Qwen3-4B-Instruct-2507-GPTQ-Int4

Text Generation • 1B • Updated Dec 12, 2025 • 3k • 1

SamMikaelson/OCR-int4-merged

1B • Updated Dec 13, 2025 • 3

SamMikaelson/ocr_random_merged

1B • Updated Dec 13, 2025

moondream/md3p-int4

Updated Dec 19, 2025 • 322 • 6

TevunahAi/Nemotron-3-Nano-30B-A3B-GPTQ

Text Generation • 6B • Updated Dec 25, 2025 • 258 • 2

uetuluk2/MiraTTS-onnx-int4

Text-to-Speech • Updated Dec 26, 2025 • 5 • 1

LiamDeacon/high-vibes-models

Automatic Speech Recognition • Updated Dec 30, 2025

ussoewwin/Hybrid-Sensitivity-Weighted-Quantization-SDXL-fp8e4m3

Text-to-Image • Updated 1 day ago • 5

jrc2139/e5-small-v2-ONNX

Feature Extraction • Updated 25 days ago • 7

DudePls/Cydonia-24B-v4.3-OpenVINO-INT4

Text Generation • Updated Jan 2 • 3

savvadesogle/T-lite-it-2.1-int4-ov

Updated Jan 3 • 1

savvadesogle/T-pro-it-2.1-int4-ov

Updated Jan 4 • 2 • 2

TevunahAi/Granite-3.3-8B-Instruct-GPTQ

Text Generation • 8B • Updated Jan 4 • 51

jrc2139/e5-large-v2-ONNX

Feature Extraction • Updated 25 days ago • 12

lewi/md3p-int4-smol

Updated Jan 15 • 8

WhoIsShe/gemma-3-1b-it-heretic-extreme-uncensored-abliterated-MNN

Text Generation • Updated Jan 16 • 20

WhoIsShe/L3-Dark-Planet-8B-HERETIC-Uncensored-Abliterated-MNN

Text Generation • Updated Jan 16 • 3