Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,892

Base only

Active filters: 5-bit

MaziyarPanahi/llama-3.2-Korean-Bllossom-3B-GGUF

Text Generation • 3B • Updated Oct 20, 2024 • 127 • 1

MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 1.58k • 6

MaziyarPanahi/Llama-3.2-3B-Overthinker-GGUF

Text Generation • 3B • Updated Oct 20, 2024 • 201 • 1

MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

Text Generation • 8B • Updated Oct 20, 2024 • 703 • 2

MaziyarPanahi/Llama3.1-8B-Chinese-Chat-GGUF

Text Generation • 8B • Updated Oct 20, 2024 • 493 • 1

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 366

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 37

MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 162

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 400 • 1

Proverbial1/magnum-v4-123b_exl2_5.0bpw_h8

Text Generation • Updated Oct 21, 2024 • 6

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • 3B • Updated Oct 23, 2024 • 326

MaziyarPanahi/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 311 • 1

jth01/aya-expanse-8b-5.0bpw-exl2

Text Generation • Updated Oct 25, 2024 • 6

async0x42/ArliAI_Mistral-Nemo-12B-ArliAI-RPMax-v1.2-exl2_5bpw

Updated Oct 25, 2024 • 3

async0x42/EVA-UNIT-01_EVA-Qwen2.5-32B-v0.0-exl2_5bpw

Text Generation • Updated Oct 26, 2024 • 9

async0x42/Gryphe_Pantheon-RP-Pure-1.6.2-22b-Small-exl2_5bpw

Updated Oct 26, 2024 • 5

async0x42/TheDrummer_Cydonia-22B-v1.2-exl2_5.0bpw

Updated Oct 27, 2024 • 2

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated Oct 27, 2024 • 13

denru/Behemoth-123B-v1.1-5_0bpw-h6-exl2-pippa

Updated Oct 27, 2024 • 3 • 2

James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS_5bpw-h8-EXL2

Updated Oct 28, 2024 • 5

James2313123/L3-DARKEST-PLANET-Seven-Rings-Of-DOOM-16.5B_5bpw-h8-EXL2

Updated Oct 27, 2024 • 5

BigHuggyD/TheDrummer_Behemoth-123B-v1.1_exl2_5.0bpw_h6

Updated Oct 28, 2024 • 5 • 1

MaziyarPanahi/L3-Nymeria-8B-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 63 • 3

async0x42/Rombos-Coder-V2.5-Qwen-7b-exl2_5.0bpw

Updated Oct 28, 2024 • 5

MaziyarPanahi/L3-Nymeria-Maid-8B-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 74

MaziyarPanahi/L3-Nymeria-v2-8B-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 63

async0x42/Rombos-LLM-V2.6-Qwen-14b-exl2_5.0bpw

Text Generation • Updated Oct 28, 2024 • 7

MaziyarPanahi/L3-Rhaenys-8B-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 74

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 155

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 168 • 2