Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

post-training-quantization

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

150

Base only

Active filters: post-training-quantization

ewin-reg/embeddinggemma-2-Quantized

Feature Extraction • 0.5B • Updated 13 days ago • 37 • 2

ewin-reg/embeddinggemma-2-int8-multimodal

Feature Extraction • 0.8B • Updated 11 days ago • 37 • 2

bg-digitalservices/Gemma-4-E4B-it-NVFP4

Text Generation • 6B • Updated Apr 6 • 833 • 1

88plug/Gemma4-E2B-it-W4A16

Image-Text-to-Text • 5B • Updated 1 day ago • 536 • 1

ewin-reg/embeddinggemma-2-0.2B-Quantized-text

Sentence Similarity • 0.2B • Updated 13 days ago • 37 • 3

iamabhayaditya/InceptionResNetV2-UNet-MBRSC

Image Segmentation • Updated 1 day ago • 83 • 1

2imi9/gpt-oss-20B-NVFP4A16-BF16

Text Generation • 21B • Updated Dec 19, 2025 • 86 • 5

hassanshka/Biomni-R0-32B-PTQ-INT8

Text Generation • 33B • Updated Feb 13 • 10 • 1

anan19990108/yolov10n-tflite

Object Detection • Updated Aug 18 • 54 • 1

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4A16

Text Generation • 15B • Updated Apr 5 • 4.14k • 5

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4

Text Generation • 15B • Updated Apr 5 • 45.8k • 34

bg-digitalservices/Apertus-8B-2509-NVFP4

Text Generation • 5B • Updated Apr 6 • 16

bg-digitalservices/Apertus-8B-2509-NVFP4A16

Text Generation • 5B • Updated Apr 6 • 16

bg-digitalservices/Apertus-8B-Instruct-2509-NVFP4

Text Generation • 5B • Updated Apr 6 • 34 • 1

bg-digitalservices/Apertus-8B-Instruct-2509-NVFP4A16

Text Generation • 5B • Updated Apr 6 • 20

bg-digitalservices/Apertus-70B-2509-NVFP4

Text Generation • 36B • Updated Apr 6 • 40

bg-digitalservices/Apertus-70B-2509-NVFP4A16

Text Generation • 36B • Updated Apr 6 • 35

bg-digitalservices/Apertus-70B-Instruct-2509-NVFP4

Text Generation • 36B • Updated Apr 6 • 21 • 2

bg-digitalservices/Apertus-70B-Instruct-2509-NVFP4A16

Text Generation • 36B • Updated Apr 6 • 16 • 1

bg-digitalservices/Gemma-4-E2B-NVFP4

Text Generation • 4B • Updated Apr 6 • 128

bg-digitalservices/Gemma-4-E2B-NVFP4A16

Text Generation • 4B • Updated Apr 6 • 27

bg-digitalservices/Gemma-4-E2B-it-NVFP4

Text Generation • 4B • Updated Apr 6 • 343 • 2

bg-digitalservices/Gemma-4-E2B-it-NVFP4A16

Text Generation • 4B • Updated Apr 6 • 33

CyberFitz/gemma-4-26B-A4B-it-NVFP4

Image-Text-to-Text • 15B • Updated Apr 6 • 211 • 1

bg-digitalservices/Gemma-4-E4B-it-NVFP4A16

Text Generation • 6B • Updated Apr 6 • 25

Entrit/tritllm-codec

Entrit/tritllm-paper

Updated May 4 • 2

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

jkim96/Qwen3.6-27B-DASHQ-INT2-g32

Image-Text-to-Text • 3B • Updated Aug 13 • 30 • 1

jkim96/Qwen3.6-27B-DASHQ-INT3-g32

Image-Text-to-Text • 3B • Updated Aug 13 • 33 • 1