Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,492

Base only

Active filters: 3-bit

MaziyarPanahi/Yamshadowexperiment28Ognoexperiment27multi_verse_model-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 81

Zoyd/microsoft_Phi-3-medium-128k-instruct-3_0bpw_exl2

Text Generation • Updated May 22, 2024 • 5

MaziyarPanahi/T3qm7Shadow-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 57

MaziyarPanahi/MyriadStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 233

MaziyarPanahi/NeuralsynthesisInex12-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 592

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 184k • 147

LoneStriker/aya-23-8B-3.0bpw-h6-exl2

Text Generation • Updated May 23, 2024 • 5

LoneStriker/aya-23-35B-3.0bpw-h6-exl2

Text Generation • Updated May 23, 2024 • 5

MaziyarPanahi/calme-2.1-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 843 • 1

MaziyarPanahi/calme-2.2-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 1.88k • 2

MaziyarPanahi/calme-2.3-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 316 • 5

Zoyd/CohereForAI_aya-23-35B-3_0bpw_exl2

Text Generation • Updated May 24, 2024 • 7

Zoyd/CohereForAI_aya-23-8B-3_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3

Zoyd/OpenLLM-Ro_RoMistral-7b-Instruct-3_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5

Zoyd/Sao10K_L3-8B-Stheno-v3.1-3_0bpw_exl2

Text Generation • Updated May 24, 2024 • 7 • 1

Zoyd/RESMPDEV_Qwen1.5-Wukong-1.8B-3_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5

Zoyd/Nanbeige_Nanbeige2-16B-Chat-3_0bpw_exl2

Question Answering • Updated May 24, 2024 • 6

Zoyd/x2bee_POLAR-14B-DPO-v1.3-3_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

Zoyd/shisa-ai_shisa-v1-phi3-14b-3_0bpw_exl2

Text Generation • Updated May 25, 2024 • 12

Zoyd/mlabonne_Meta-Llama-3-12B-Instruct-3_0bpw_exl2

Text Generation • Updated May 25, 2024 • 5

Zoyd/xxx777xxxASD_L3_SnowStorm_4x8B-3_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

Zoyd/failspy_Smaug-Llama-3-70B-Instruct-abliterated-v3-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 4

Zoyd/openchat_openchat-3.6-8b-20240522-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 7

Zoyd/flammenai_Mahou-1.2-phi-14B-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 7

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • 4B • Updated May 26, 2024 • 309 • 1

Zoyd/cypienai_cymist-2-v03-SFT-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 4

Zoyd/Delcos_Velara-11B-v3-3_0bpw_exl2

Text Generation • Updated May 26, 2024 • 4

Zoyd/TheSkullery_Aura-Llama-Abliterated-3_0bpw_exl2

Text Generation • Updated May 27, 2024 • 5

Zoyd/prince-canuma_Llama-3-6B-v0.1-3_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7