bot-lab-21/GLM-5.3-EXL3-3.2bpw-Pollard-Smooth
Text Generation • 157B • Updated • 297 • 2
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
42
Active filters: smoothquant
adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8
Text Generation • Updated • 29 • 1
neonconverse/gemma-3-27b-abliterated-w8a8-8bit
Updated
ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16
Text Generation • 6B • Updated • 19
JEILDLWLRMA/Qwen3VL-8B-Instruct-FP8
Image-to-Text • 9B • Updated • 16 • 1
JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4
Image-to-Text • 6B • Updated • 19.6k • 4
JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic
Image-to-Text • 5B • Updated • 70
JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4
Image-to-Text • 3B • Updated • 22.9k • 2
cstr/Octen-Embedding-0.6B-ONNX-INT8
Sentence Similarity • Updated • 16 • 2
cstr/F2LLM-v2-0.6B-ONNX-INT8
Sentence Similarity • Updated • 20
jsyeom/llama-2-13b-hf-smooth
13B • Updated • 11
emreyigitozturk/llama-3.2-3b-smoothquant-gptq-hybrid
Text Generation • 4B • Updated • 19
vrfai/Qwen3-ASR-1.7B-int8
Automatic Speech Recognition • 2B • Updated • 3
Sensen02/Fast_dVLM_3B_W8A8_FP8
4B • Updated • 19 • 2
cstr/jina-embeddings-v5-text-small-retrieval-onnx-int8
Sentence Similarity • Updated • 34
pantinor/parakeet-tdt-0.6b-v3-smoothquant
Updated
stellars/mmBERT-base-openvino-int8
Feature Extraction • Updated • 12
Freaksterz/Qwen3.8-27B-SmoothQuant-W8A8-INT8
22B • Updated • 14.7k • 22
spectator2026/Qwen3.8-27B-int8-prefill-sidecar
Updated
akumaburn/Qwen3.8-27B-heretic-SmoothQuant-W8A8-INT8
Image-Text-to-Text • 27B • Updated • 2.83k • 1
guanwenyu1995/MiniMAX-M2.7-MXFP4-CANN
Text Generation • 115B • Updated • 70
JoaoZaokk/Gemma-3-12B-it-Heretic-W4A8
Updated
florianvoss/Qwen3.5-0.8B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-2B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-9B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-4B-Autoround-a16w4-Modalix
Updated
CompressedMichael/Qwen3-VL-30B-A3B-Instruct-SmoothQuant-W8A8
Image-Text-to-Text • 31B • Updated • 66
akumaburn/Swift-Qwen3.8-27b-heretic-SmoothQuant-W8A8-INT8
Image-Text-to-Text • 27B • Updated • 156
Noir-Lime/qwen3-forced-aligner-0.6b-onnx-int8
Updated
chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 339