Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,884

Base only

Active filters: 5-bit

Zoyd/CohereForAI_aya-23-8B-5_0bpw_exl2

Text Generation • Updated May 24, 2024 • 8

Zoyd/OpenLLM-Ro_RoMistral-7b-Instruct-5_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5

Zoyd/Sao10K_L3-8B-Stheno-v3.1-5_0bpw_exl2

Text Generation • Updated May 24, 2024 • 4

Zoyd/RESMPDEV_Qwen1.5-Wukong-1.8B-5_0bpw_exl2

Text Generation • Updated May 24, 2024 • 4

Zoyd/Nanbeige_Nanbeige2-16B-Chat-5_0bpw_exl2

Question Answering • Updated May 24, 2024 • 6

Zoyd/x2bee_POLAR-14B-DPO-v1.3-5_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

gbueno86/Meta-LLama-3-Cat-A-LLama-70b-exl2-5.0bpw

Text Generation • Updated May 25, 2024 • 7

Zoyd/shisa-ai_shisa-v1-phi3-14b-5_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

Zoyd/mlabonne_Meta-Llama-3-12B-Instruct-5_0bpw_exl2

Text Generation • Updated May 25, 2024 • 9

Zoyd/xxx777xxxASD_L3_SnowStorm_4x8B-5_0bpw_exl2

Text Generation • Updated May 25, 2024 • 4

Zoyd/failspy_Smaug-Llama-3-70B-Instruct-abliterated-v3-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 4

Zoyd/openchat_openchat-3.6-8b-20240522-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 6

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 7

Zoyd/flammenai_Mahou-1.2-phi-14B-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 6

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • 4B • Updated May 26, 2024 • 309 • 1

Zoyd/cypienai_cymist-2-v03-SFT-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 6

Zoyd/Delcos_Velara-11B-v3-5_0bpw_exl2

Text Generation • Updated May 26, 2024 • 6

Zoyd/TheSkullery_Aura-Llama-Abliterated-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 6

Zoyd/prince-canuma_Llama-3-6B-v0.1-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/mlabonne_Daredevil-8B-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 8

Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 14

Zoyd/JetBrains_CodeLlama-7B-KStack-clean-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/flammenai_Mahou-1.2a-llama3-8B-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/RESMPDEV_Qwen1.5-Wukong-4B-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 4

Zoyd/mlabonne_Llama-3-8B-Instruct-abliterated-dpomix-5_0bpw_exl2

Text Generation • Updated May 28, 2024 • 5

Zoyd/mlabonne_Daredevil-8B-abliterated-5_0bpw_exl2

Text Generation • Updated May 28, 2024 • 6

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-5_0bpw_exl2

Text Generation • Updated May 28, 2024 • 6

BigHuggyD/jukofyork_Dark-Miqu-103B-5.0bpw-h8-exl2

Text Generation • Updated May 29, 2024 • 9

MaziyarPanahi/albertlight-7b-GGUF

Text Generation • 13B • Updated May 29, 2024 • 227

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 1, 2024 • 2.35k • 9