Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

74

Base only

Active filters: sub-4-bit

liodon-ai/Qwen2.5-1.5B-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 839

liodon-ai/Qwen2.5-3B-imatrix-GGUF

Text Generation • 3B • Updated 19 days ago • 804

liodon-ai/DeepHat-V1-7B-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 890

liodon-ai/Qwen3-0.6B-Base-imatrix-GGUF

Text Generation • 0.6B • Updated 19 days ago • 834

liodon-ai/Qwen2-0.5B-imatrix-GGUF

Text Generation • 0.5B • Updated 19 days ago • 808

liodon-ai/Qwen2-1.5B-Instruct-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 868

liodon-ai/Qwen2.5-Coder-7B-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 831

liodon-ai/Mythos-nano-imatrix-GGUF

Text Generation • 3B • Updated 19 days ago • 828

liodon-ai/saiga_llama3_8b-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 1.14k

liodon-ai/Qwen2.5-Coder-1.5B-Instruct-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 839

liodon-ai/Qwen2.5-Coder-14B-Instruct-imatrix-GGUF

Text Generation • 15B • Updated 19 days ago • 930

liodon-ai/Qwen3-4B-Base-imatrix-GGUF

Text Generation • 4B • Updated 19 days ago • 808

liodon-ai/mythos-9b-unhinged-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 876

liodon-ai/Qwen3-1.7B-Base-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 826

liodon-ai/Qwen2.5-Math-1.5B-Instruct-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 824

liodon-ai/Qwen3-8B-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 883

liodon-ai/MiniCPM5-1B-imatrix-GGUF

Text Generation • 1B • Updated 19 days ago • 891

liodon-ai/Qwen2.5-7B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 807

liodon-ai/Qwen2.5-1.5B-Instruct-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 796

liodon-ai/Qwen2.5-3B-Instruct-imatrix-GGUF

Text Generation • 3B • Updated 19 days ago • 841

liodon-ai/Qwen3-4B-Instruct-2507-imatrix-GGUF

Text Generation • 4B • Updated 19 days ago • 943

liodon-ai/Meta-Llama-3.1-8B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated 19 days ago • 1.06k

liodon-ai/TinyLlama-1.1B-Chat-v1.0-imatrix-GGUF

Text Generation • 1B • Updated 19 days ago • 432

liodon-ai/Privasis-Cleaner-0.6B-imatrix-GGUF

Text Generation • 0.6B • Updated 19 days ago • 812

liodon-ai/FastContext-1.0-4B-SFT-imatrix-GGUF

Text Generation • 4B • Updated 19 days ago • 951

liodon-ai/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-imatrix-GGUF

Text Generation • 1B • Updated 19 days ago • 1.05k

liodon-ai/SmolLM2-1.7B-Instruct-imatrix-GGUF

Text Generation • 2B • Updated 19 days ago • 303

liodon-ai/bloomz-560m-imatrix-GGUF

Text Generation • 0.6B • Updated 18 days ago • 857

liodon-ai/Hermes-3-Llama-3.1-8B-imatrix-GGUF

Text Generation • 8B • Updated 18 days ago • 1.33k

liodon-ai/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-imatrix-GGUF

Text Generation • 1B • Updated 17 days ago • 844