Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,789

Base only

Active filters: 2-bit

MaziyarPanahi/QwenSlerp7-14B-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 21

MaziyarPanahi/FuseQwQen-7B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 19

MaziyarPanahi/Q2.5-Veltha-14B-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 39

MaziyarPanahi/Qwen2.5-14B-Unity-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 103

MaziyarPanahi/Qwenvergence-14B-v3-Prose-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 24

MaziyarPanahi/FuseCyberMix-Qwen-2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 39

MaziyarPanahi/UwU-14B-Math-v0.2-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 64

MaziyarPanahi/TQ2.5-14B-Aletheia-v1-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 21

MaziyarPanahi/VirtuosoSmall-InstructModelStock-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 20

MaziyarPanahi/TQ2.5-14B-Neon-v1-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 51

MaziyarPanahi/Qwen2.5-14B-Wernickev5-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 11

MaziyarPanahi/WiNGPT-Babel-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 29 • 1

gxunda/Qwen2.5-0.5B-Instruct-2bit-no-act

0.6B • Updated Jan 7, 2025 • 5

MaziyarPanahi/Qwen2.5-14B-Merge-GGUF

Text Generation • 15B • Updated Jan 6, 2025 • 52

MaziyarPanahi/Qwen-2.5-14B-MINUS-GGUF

Text Generation • 15B • Updated Jan 6, 2025 • 45

MaziyarPanahi/UwU-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 56

MaziyarPanahi/light-3B-GGUF

Text Generation • 3B • Updated Jan 7, 2025 • 14

gxunda/Qwen2.5-3B-Instruct-2bit-no-act

3B • Updated Jan 7, 2025 • 2

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • 0.5B • Updated Jan 7, 2025 • 721 • 4

MaziyarPanahi/Matsu-7B-GGUF

Text Generation • 8B • Updated Jan 7, 2025 • 18

mlx-community/qwen2.5-0.5b-instruct-q2

Text Generation • 46.4M • Updated Jan 9, 2025 • 26

mlx-community/phi-4-2bit

Text Generation • 2B • Updated Jan 12, 2025 • 13 • 1

MaziyarPanahi/phi3.5_mini_exp_825_uncensored-GGUF

Text Generation • 4B • Updated Jan 9, 2025 • 68

MaziyarPanahi/phi-2-instruct-v0.1-GGUF

Text Generation • 3B • Updated Jan 9, 2025 • 32

MaziyarPanahi/phi-2-pytdml-GGUF

Text Generation • 3B • Updated Jan 9, 2025 • 18

MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF

Text Generation • 14B • Updated Jan 9, 2025 • 41

MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF

Text Generation • 4B • Updated Jan 9, 2025 • 30

MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • 4B • Updated Jan 9, 2025 • 115

MaziyarPanahi/fietje-2-instruct-GGUF

Text Generation • 3B • Updated Jan 9, 2025 • 25

mlx-community/phi-4-abliterated-2bit

Text Generation • 1B • Updated Jan 9, 2025 • 16