Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,558

Base only

Active filters: 6-bit

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 59 • 1

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 20 • 1

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 25 • 1

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • 12B • Updated Dec 28, 2024 • 76 • 1

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 20

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 42

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 26

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 27

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 82

MaziyarPanahi/ZEUS-8B-V10-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 44

MaziyarPanahi/Tulu-MathLingo-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 21

Statuo/Sao10k-Qwen2.5-32b-Kunou-EXL2-6bpw

Text Generation • Updated Dec 30, 2024 • 8

MaziyarPanahi/Llama-Deepsync-1B-GGUF

Text Generation • 1B • Updated Dec 30, 2024 • 23

MaziyarPanahi/Llama-Deepsync-3B-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 105

MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 45

MaziyarPanahi/Kosmos-EVAA-gamma-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 30

MaziyarPanahi/Codepy-Deepthink-3B-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 84

MaziyarPanahi/aya-expanse-8b-abliterated-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 131 • 1

MaziyarPanahi/paya-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 61

MaziyarPanahi/Ministral-8B-Instruct-2410-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 155 • 3

Statuo/Sao10K_14B-Qwen2.5-Freya-v1-EXL2-6bpw

Text Generation • Updated Jan 3, 2025 • 8

MaziyarPanahi/huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation • 15B • Updated Jan 3, 2025 • 80

MaziyarPanahi/Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 60

MaziyarPanahi/oxy-1-small-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 114

MaziyarPanahi/RQwen-v0.1-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 61

MaziyarPanahi/LongWriter-Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 4, 2025 • 67 • 1

MaziyarPanahi/openbuddy-qwen2.5llamaify-14b-v23.3-200k-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 136

MaziyarPanahi/Qwen2.5-14B-Gutenberg-1e-Delta-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 47

MaziyarPanahi/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno-GGUF

Text Generation • 15B • Updated Jan 4, 2025 • 17

MaziyarPanahi/x1-7B-v0.1-GGUF

Text Generation • 8B • Updated Jan 4, 2025 • 123