Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,590

Base only

Active filters: 6-bit

MaziyarPanahi/MergerixInex12-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 237

MaziyarPanahi/Inex12T3qm7xp-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 171

MaziyarPanahi/Yamshadowexperiment28Ognoexperiment27multi_verse_model-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 87

MaziyarPanahi/T3qm7Shadow-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 60

MaziyarPanahi/MyriadStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 270

Zoyd/microsoft_Phi-3-medium-128k-instruct-6_0bpw_exl2

Text Generation • Updated May 22, 2024 • 7

MaziyarPanahi/NeuralsynthesisInex12-7B-GGUF

Text Generation • 7B • Updated May 22, 2024 • 610

blockblockblock/airoboros-l2-13b-gpt4-1.4.1-bpw6-exl2

Text Generation • Updated May 22, 2024 • 6

LoneStriker/aya-23-8B-6.0bpw-h6-exl2

Text Generation • Updated May 23, 2024 • 9 • 1

LoneStriker/aya-23-35B-6.0bpw-h6-exl2

Text Generation • Updated May 23, 2024 • 11

MaziyarPanahi/calme-2.1-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 754 • 1

MaziyarPanahi/calme-2.2-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 2.05k • 2

MaziyarPanahi/calme-2.3-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 286 • 5

Zoyd/CohereForAI_aya-23-35B-6_0bpw_exl2

Text Generation • Updated May 24, 2024 • 9

Zoyd/CohereForAI_aya-23-8B-6_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5 • 2

Zoyd/OpenLLM-Ro_RoMistral-7b-Instruct-6_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5

Zoyd/Sao10K_L3-8B-Stheno-v3.1-6_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5

Zoyd/RESMPDEV_Qwen1.5-Wukong-1.8B-6_0bpw_exl2

Text Generation • Updated May 24, 2024 • 6

Zoyd/Nanbeige_Nanbeige2-16B-Chat-6_0bpw_exl2

Question Answering • Updated May 24, 2024 • 7

vikarti-anatra/Faro-Yi-9B-DPO-6bpw-exl2

Text Generation • Updated May 24, 2024 • 6 • 1

Zoyd/x2bee_POLAR-14B-DPO-v1.3-6_0bpw_exl2

Text Generation • Updated May 25, 2024 • 12

Zoyd/shisa-ai_shisa-v1-phi3-14b-6_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

Zoyd/mlabonne_Meta-Llama-3-12B-Instruct-6_0bpw_exl2

Text Generation • Updated May 25, 2024 • 9

Zoyd/xxx777xxxASD_L3_SnowStorm_4x8B-6_0bpw_exl2

Text Generation • Updated May 25, 2024 • 9

Zoyd/failspy_Smaug-Llama-3-70B-Instruct-abliterated-v3-6_0bpw_exl2

Text Generation • Updated May 26, 2024 • 6

Zoyd/openchat_openchat-3.6-8b-20240522-6_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-6_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8

Zoyd/flammenai_Mahou-1.2-phi-14B-6_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • 4B • Updated May 26, 2024 • 355 • 1

Zoyd/cypienai_cymist-2-v03-SFT-6_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8