adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8
Text Generation • Updated • 9 • 1
Edit Models filters
Apps
Inference Providers
Active filters: smoothquant
neonconverse/gemma-3-27b-abliterated-w8a8-8bit
Updated
ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16
Text Generation • 6B • Updated • 4
JEILDLWLRMA/Qwen3VL-8B-Instruct-FP8
Image-to-Text • 9B • Updated • 61 • 1
JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4
Image-to-Text • 6B • Updated • 108 • 1
JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic
Image-to-Text • 5B • Updated • 88
JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4
Image-to-Text • 3B • Updated • 61 • 2
cstr/Octen-Embedding-0.6B-ONNX-INT8
Sentence Similarity • Updated • 60 • 1
cstr/F2LLM-v2-0.6B-ONNX-INT8
Sentence Similarity • Updated • 48
jsyeom/llama-2-13b-hf-smooth
13B • Updated • 3
emreyigitozturk/llama-3.2-3b-smoothquant-gptq-hybrid
Text Generation • 4B • Updated • 3
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 2
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 8
vrfai/Qwen3-ASR-1.7B-int8
Automatic Speech Recognition • 2B • Updated • 3
Sensen02/Fast_dVLM_3B_W8A8_FP8
Updated • 21
cstr/jina-embeddings-v5-text-small-retrieval-onnx-int8
Sentence Similarity • Updated • 59