Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,494

Base only

Active filters: 3-bit

MaziyarPanahi/Qwexit-2.5-14B-2024-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 54

MaziyarPanahi/Deepthink-Reasoning-7B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 87

MaziyarPanahi/Qwen2.5-14B-Vimarckoso-v3-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 35

MaziyarPanahi/miscii-14b-1225-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 37 • 1

mlx-community/DeepSeek-V3-3bit

105B • Updated Jan 5, 2025 • 70 • 3

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-SocraticLM-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 49

MaziyarPanahi/iq-code-evmind-7b-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 30

MaziyarPanahi/iq-code-evmind-14b-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 53

MaziyarPanahi/Qwen2.5-14B-Brocav3-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 36

MaziyarPanahi/DRT-o1-7B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 37

MaziyarPanahi/DRT-o1-14B-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 51

MaziyarPanahi/Q2.5-Veltha-14B-0.5-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 37

MaziyarPanahi/QwenSlerp7-14B-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 19

MaziyarPanahi/FuseQwQen-7B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 49

MaziyarPanahi/Q2.5-Veltha-14B-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 38

MaziyarPanahi/Qwen2.5-14B-Unity-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 88

mlx-community/DeepSeek-V3-3bit-bf16

105B • Updated Jan 5, 2025 • 34 • 2

MaziyarPanahi/Qwenvergence-14B-v3-Prose-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 67

MaziyarPanahi/FuseCyberMix-Qwen-2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 67

MaziyarPanahi/UwU-14B-Math-v0.2-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 63

MaziyarPanahi/TQ2.5-14B-Aletheia-v1-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 36

MaziyarPanahi/VirtuosoSmall-InstructModelStock-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 20

mlx-community/Mistral-Nemo-Instruct-2407-3bit

2B • Updated Jan 9, 2025 • 33 • 1

MaziyarPanahi/TQ2.5-14B-Neon-v1-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 58

MaziyarPanahi/Qwen2.5-14B-Wernickev5-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 13

MaziyarPanahi/WiNGPT-Babel-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 35 • 1

MaziyarPanahi/Qwen2.5-14B-Merge-GGUF

Text Generation • 15B • Updated Jan 6, 2025 • 44

mlx-community/Qwen2.5-Coder-32B-Instruct-abliterated-3bit

Text Generation • 4B • Updated Jan 6, 2025 • 108 • 1

MaziyarPanahi/Qwen-2.5-14B-MINUS-GGUF

Text Generation • 15B • Updated Jan 6, 2025 • 62

MaziyarPanahi/UwU-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 75