Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,581

Base only

Active filters: 6-bit

MaziyarPanahi/mergekit-slerp-ueqsixf-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 832

blockblockblock/dolphin-2.9.2-qwen2-7b-bpw6-exl2

Text Generation • Updated Jun 18, 2024 • 6 • 1

MaziyarPanahi/mergekit-slerp-xlkdlta-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 187 • 1

MaziyarPanahi/mergekit-slerp-ksadkxl-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 902 • 1

MaziyarPanahi/mergekit-slerp-qcerglv-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 68 • 1

MaziyarPanahi/llama-world-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 196 • 1

MaziyarPanahi/gemma-gemma-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 312

MaziyarPanahi/LWM-14b-Text-Chat-1M-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 765

MaziyarPanahi/mergekit-slerp-ozbsicw-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 1.08k

MaziyarPanahi/mergekit-slerp-jeyctse-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 701

MaziyarPanahi/mergekit-ties-kkhkcqw-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 840

MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 458 • 1

MaziyarPanahi/mergekit-slerp-zzizhry-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 819 • 1

MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 181 • 1

MaziyarPanahi/mergekit-slerp-gpprpds-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 788 • 1

dreamgen/opus-v1.4-70b-llama3-exl2-6.0bpw-h6

Text Generation • Updated Jun 19, 2024 • 6 • 1

dreamgen/opus-v1.4-70b-llama3-exl2-6.0bpw-h8

Text Generation • Updated Jun 19, 2024 • 7 • 3

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 20, 2024 • 174k • 19

lucyknada/alpindale-magnum-72b-v1-6.0bpw

Text Generation • Updated Jun 19, 2024 • 5

bigstorm/dolphin-2.9.2-qwen2-72b-6.0bpw-exl2

Text Generation • Updated Jun 21, 2024 • 7 • 1

bullerwins/Hermes-2-Theta-Llama-3-70B-exl2_6.0bpw

Text Generation • Updated Jun 21, 2024 • 4

bigstorm/dolphin-2.9.1-llama-3-70b-6.0bpw-exl2

Text Generation • Updated Jul 4, 2024 • 14 • 3

FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-6.0bpw-h8-exl2

Text Generation • Updated Jun 22, 2024 • 8 • 1

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_6.0bpw

Text Generation • Updated Jun 22, 2024 • 6

bullerwins/Llama-3SOME-8B-v2-exl2_6.0bpw

Text Generation • Updated Jun 27, 2024 • 4 • 2

blockblockblock/gpt2-bpw6-exl2

Text Generation • Updated Jun 22, 2024 • 17

Sinensis/DarkForest-20B-v3.0-bpw6.0-h8-exl2

Text Generation • Updated Jun 26, 2025 • 7

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_6.0bpw

Text Generation • Updated Jul 25, 2025 • 6

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_6.0bpw

Text Generation • Updated Jul 25, 2025 • 5

bigstorm/firefunction-v2-6.0bpw-8hb-exl2

Text Generation • Updated Jun 24, 2024 • 5