Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,001

Base only

Active filters: quantized

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 139 • 2

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.4v-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 157 • 1

MaziyarPanahi/MN-Chinofun-12B-3-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 61 • 2

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 87

TheMelonGod/moxin-chat-7b-exl2

Text Generation • Updated Dec 31, 2024 • 11

ktoprakucar/granite-guardian-3.1-2b-Q8-GGUF

Text Generation • 3B • Updated Jan 15, 2025 • 9 • 2

theeseus-ai/CriticalThinkerRisk-8B-GGUF

8B • Updated Dec 27, 2024 • 21 • 1

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 19

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 21 • 1

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 105 • 1

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 50 • 1

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 34 • 1

TheMelonGod/moxin-llm-7b-exl2

Text Generation • Updated Dec 28, 2024 • 15

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • 12B • Updated Dec 28, 2024 • 146 • 1

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 11

TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2

Text Generation • Updated Dec 31, 2024 • 16

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 57

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 38

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 32

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 114

MaziyarPanahi/ZEUS-8B-V10-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 53

MaziyarPanahi/Tulu-MathLingo-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 34

MaziyarPanahi/Llama-Deepsync-1B-GGUF

Text Generation • 1B • Updated Dec 30, 2024 • 26

MaziyarPanahi/Llama-Deepsync-3B-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 173

MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 39

MaziyarPanahi/Kosmos-EVAA-gamma-light-8B-GGUF

Text Generation • 8B • Updated Dec 30, 2024 • 23

MaziyarPanahi/Codepy-Deepthink-3B-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 80

MaziyarPanahi/aya-expanse-8b-abliterated-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 217 • 1

MaziyarPanahi/paya-GGUF

Text Generation • 8B • Updated Jan 1, 2025 • 138

akhbar/Qwen2.5-32B-Instruct-abliterated-8bit-128g-actorder_True-GPTQ

Text Generation • 33B • Updated Jan 1, 2025 • 6