Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,909

Base only

Active filters: 5-bit

MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 43

MaziyarPanahi/Kosmos-EVAA-gamma-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 27

MaziyarPanahi/Codepy-Deepthink-3B-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 79

denru/Monstral-123B-v2x2-5_0bpw-h8-exl2-pippa

Text Generation • Updated Jan 1, 2025 • 9

denru/Monstral-123B-v2-Behemoth-v2.2-Magnum-v4-123B-169B-5_0bpw-h8-exl2-pippa

Text Generation • Updated Jan 1, 2025 • 10

MaziyarPanahi/aya-expanse-8b-abliterated-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 159 • 1

MaziyarPanahi/paya-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 91

MaziyarPanahi/Ministral-8B-Instruct-2410-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 146 • 3

MaziyarPanahi/huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation • 15B • Updated Jan 3, 2025 • 111

MaziyarPanahi/Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 76

MaziyarPanahi/oxy-1-small-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 129

MaziyarPanahi/RQwen-v0.1-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 68

MaziyarPanahi/LongWriter-Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 4, 2025 • 73 • 1

MaziyarPanahi/openbuddy-qwen2.5llamaify-14b-v23.3-200k-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 161

MikeRoz/sophosympatheia_Sophos-eva-euryale-v1.0-5.0bpw-h6-exl2

Text Generation • Updated Jan 4, 2025 • 7 • 1

MaziyarPanahi/Qwen2.5-14B-Gutenberg-1e-Delta-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 52

MaziyarPanahi/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 18

MaziyarPanahi/x1-7B-v0.1-GGUF

Text Generation • 8B • Updated Jan 4, 2025 • 127

MaziyarPanahi/QwenStock1-14B-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 28

MaziyarPanahi/QwenSlerp-14B-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 10

MaziyarPanahi/14B-Qwen2.5-Freya-x1-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 65

MaziyarPanahi/Eurus-2-7B-PRIME-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 18

MaziyarPanahi/Qwexit-2.5-14B-2024-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 59

MaziyarPanahi/Deepthink-Reasoning-7B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 153

MaziyarPanahi/Qwen2.5-14B-Vimarckoso-v3-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 26

MaziyarPanahi/miscii-14b-1225-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 105 • 1

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-SocraticLM-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 57

MaziyarPanahi/iq-code-evmind-7b-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 25

MaziyarPanahi/iq-code-evmind-14b-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 65

MaziyarPanahi/Qwen2.5-14B-Brocav3-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 54