Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

277

Base only

Active filters: cpu

magiccodingman/Qwen3-4B-Instruct-2507-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 103

GPTcn/GPT_teacher-3.37M-cn

Text Generation • Updated Nov 16, 2025 • 2 • 3

magiccodingman/Qwen3-4B-Thinking-2507-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 38 • 1

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 31 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 108 • 2

magiccodingman/Seed-OSS-36B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 36B • Updated Dec 3, 2025 • 15 • 1

magiccodingman/Granite-4.0-H-350M-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 0.3B • Updated Dec 2, 2025 • 23

magiccodingman/Granite-4.0-H-1B-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 1B • Updated Dec 3, 2025 • 36

magiccodingman/Apriel-1.5-15b-Thinker-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 301

magiccodingman/Qwen3-VL-8B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Apr 25 • 338 • 1

magiccodingman/Qwen3-VL-8B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Dec 3, 2025 • 134 • 2

magiccodingman/Qwen3-VL-32B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 33B • Updated Dec 3, 2025 • 43

Dogacel/DeepSeek-OCR-Metal-MPS

Image-Text-to-Text • 3B • Updated Dec 24, 2025 • 47 • 13

ucrelnlp/PyMUSAS-Neural-Multilingual-Small-BEM

Updated Jan 19 • 4

ucrelnlp/PyMUSAS-Neural-Multilingual-Base-BEM

Updated Jan 19 • 33 • 1

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 101 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 545 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 482 • 2

Clem-CPu/Tiny-lamina-english-fragment

Text Generation • 202k • Updated Dec 4, 2025 • 7

Kebob/DeepSeek-V3.2-CPU-NUMA2-AMXINT4

Updated Dec 4, 2025 • 7

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 514 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 457 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 1.02k • 10

pnnbao-ump/VieNeu-TTS-q4-gguf

Text-to-Speech • 0.6B • Updated Jan 15 • 219 • 2

pnnbao-ump/VieNeu-TTS-q8-gguf

Text-to-Speech • 0.6B • Updated Jan 15 • 106 • 3

laikastudio/laikadream-v1

Unconditional Image Generation • Updated Dec 18, 2025 • 1

onnx-community/mmBERT-small-ONNX

Fill-Mask • Updated Dec 14, 2025 • 10 • 3

open-ticket-ai/tags-lite-free-0-6b-int8

Text Classification • Updated Dec 14, 2025 • 16

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 380 • 2

mgumowsk/YOLO11

Object Detection • Updated Dec 17, 2025 • 1