Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

887

Full-text search

Active filters: quantization

abdou-u/MNLP_M3_quantized_dpo_mcqa_model

Multiple Choice • 0.6B • Updated Jun 8, 2025

kevin510/friday-4bit

Text Generation • 4B • Updated Sep 23, 2025 • 5

agentlans/SmolLM2-135M-Instruct-GGUF

0.1B • Updated Jun 6, 2025 • 7

humbleakh/qwen2.5-vl-3b-4bit-chain-of-zoom

Image-Text-to-Text • 4B • Updated Jun 8, 2025 • 7

humbleakh/stable-diffusion-4bit-chain-of-zoom

Updated Jun 8, 2025

humbleakh/chain-of-zoom-4bit-complete

Image-to-Image • Updated Jun 8, 2025

DESUCLUB/Qwen3-14B-v0.2-deepresearch-no-think-100-step-bf16-quantized.w8a8

Text Generation • Updated Jun 10, 2025 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Updated Jun 11, 2025

Kikinoking/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated Jun 10, 2025

cogni-x/CogniXpert-Model-v1.0

Text Generation • Updated Dec 21, 2025

textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 12, 2025 • 66

vlad-m-dev/mobilenetv2_doc_photo_quant

Image Classification • Updated Jun 15, 2025 • 1

vlad-m-dev/mobilenet_v3_small_onnx_photo_doc

Image Classification • Updated Jun 15, 2025 • 2

Peacemann/Meta-Llama-3-8B-Instruct_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/google_gemma-2-9b-it_LMUL

Text Generation • 9B • Updated Jun 15, 2025

Peacemann/google_gemma-3-4b-it_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/mistralai_Mistral-7B-Instruct-v0.2_LMUL

Text Generation • 7B • Updated Jun 15, 2025

Peacemann/Qwen_Qwen2-7B-Instruct_LMUL

Text Generation • Updated Jun 15, 2025 • 1

Peacemann/mistralai_Ministral-8B-Instruct-2410_LMUL

Text Generation • Updated Jun 15, 2025 • 3

Peacemann/Qwen_Qwen3-32B_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/Qwen_QwQ-32B_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/nvidia_Llama-3_3-Nemotron-Super-49B-v1_LMUL

Text Generation • 50B • Updated Jun 15, 2025 • 1

LibraxisAI/QwQ-32B-MLX-Q5

33B • Updated Jun 24, 2025 • 11

LibraxisAI/Qwen3-14b-MLX-Q5

15B • Updated Jun 17, 2025 • 29

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 5B • Updated Jun 17, 2025

raul-delarosa99/bert-base-multilingual-cased-ner-es-onnx-static-int8

Token Classification • Updated Aug 25, 2025 • 168

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jun 23, 2025 • 17

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated Jun 23, 2025 • 224

ramgpt/jan-nano-4b-gptqmodel-4bit

Text Generation • 4B • Updated Jun 20, 2025 • 1 • 2

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Jun 23, 2025 • 2 • 2