Freaksterz/Qwen3.8-27B-SmoothQuant-W8A8-INT8
22B • Updated • 14.4k • 23
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
42
Active filters: smoothquant
bot-lab-21/GLM-5.3-EXL3-3.2bpw-Pollard-Smooth
Text Generation • 157B • Updated • 300 • 2
adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8
Text Generation • Updated • 31 • 1
neonconverse/gemma-3-27b-abliterated-w8a8-8bit
Updated
ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16
Text Generation • 6B • Updated • 20
JEILDLWLRMA/Qwen3VL-8B-Instruct-FP8
Image-to-Text • 9B • Updated • 16 • 1
JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4
Image-to-Text • 6B • Updated • 13.7k • 4
JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic
Image-to-Text • 5B • Updated • 65
JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4
Image-to-Text • 3B • Updated • 24.3k • 2
cstr/Octen-Embedding-0.6B-ONNX-INT8
Sentence Similarity • Updated • 15 • 2
cstr/F2LLM-v2-0.6B-ONNX-INT8
Sentence Similarity • Updated • 20
jsyeom/llama-2-13b-hf-smooth
13B • Updated • 11
emreyigitozturk/llama-3.2-3b-smoothquant-gptq-hybrid
Text Generation • 4B • Updated • 19
vrfai/Qwen3-ASR-1.7B-int8
Automatic Speech Recognition • 2B • Updated • 3
Sensen02/Fast_dVLM_3B_W8A8_FP8
4B • Updated • 18 • 2
cstr/jina-embeddings-v5-text-small-retrieval-onnx-int8
Sentence Similarity • Updated • 34
pantinor/parakeet-tdt-0.6b-v3-smoothquant
Updated
stellars/mmBERT-base-openvino-int8
Feature Extraction • Updated • 12
spectator2026/Qwen3.8-27B-int8-prefill-sidecar
Updated
akumaburn/Qwen3.8-27B-heretic-SmoothQuant-W8A8-INT8
Image-Text-to-Text • 27B • Updated • 2.93k • 1
guanwenyu1995/MiniMAX-M2.7-MXFP4-CANN
Text Generation • 115B • Updated • 71
JoaoZaokk/Gemma-3-12B-it-Heretic-W4A8
Updated
florianvoss/Qwen3.5-0.8B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-2B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-9B-Autoround-a16w4-Modalix
Updated
florianvoss/Qwen3.5-4B-Autoround-a16w4-Modalix
Updated
CompressedMichael/Qwen3-VL-30B-A3B-Instruct-SmoothQuant-W8A8
Image-Text-to-Text • 31B • Updated • 68
akumaburn/Swift-Qwen3.8-27b-heretic-SmoothQuant-W8A8-INT8
Image-Text-to-Text • 27B • Updated • 161
Noir-Lime/qwen3-forced-aligner-0.6b-onnx-int8
Updated
chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 341