Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,900

Base only

Active filters: 5-bit

MaziyarPanahi/Qwen1.5-MoE-A2.7B-Wikihow-GGUF

Text Generation • 14B • Updated Dec 19, 2024 • 23

MaziyarPanahi/CabraQwen14b-GGUF

Text Generation • 14B • Updated Dec 19, 2024 • 33

MaziyarPanahi/Qwen-14B-Chat-LLaMAfied-GGUF

Text Generation • 14B • Updated Dec 19, 2024 • 34

MaziyarPanahi/Qwen2.5-Coder-14B-Instruct-abliterated-GGUF

Text Generation • 15B • Updated Dec 20, 2024 • 153

MaziyarPanahi/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 125 • 6

MaziyarPanahi/fratricide-12B-Unslop-Mell-DARKNESS-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 10

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.5v-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 61

MaziyarPanahi/moxin-llm-7b-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 42 • 1

Kotokin/EVA-UNIT-01_EVA-LLaMA-3.33-70B-v0.1-exl2-5bpw

Text Generation • Updated Dec 21, 2024 • 8

MaziyarPanahi/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 90

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 108 • 2

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.4v-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 150 • 1

MaziyarPanahi/MN-Chinofun-12B-3-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 127 • 2

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 71

DBMe/Anubis-70B-v1-5.0bpw-h6-exl2

Updated Jan 1, 2025 • 9

Dracones/Anubis-70B-v1_exl2_5.0bpw

Text Generation • Updated Dec 25, 2024 • 8

Dracones/QVQ-72B-Preview_exl2_5.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 7

bullerwins/QVQ-72B-Preview-exl2_5.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 7

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 17

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 26 • 1

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 83 • 1

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 21 • 1

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 26 • 1

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • 12B • Updated Dec 28, 2024 • 90 • 1

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 13

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 40

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 35

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 27

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 89

MaziyarPanahi/ZEUS-8B-V10-GGUF

Text Generation • 8B • Updated Dec 28, 2024 • 44