Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,714

Base only

Active filters: 8-bit

grimjim/fireblossom-32K-7B-8.0bpw_h8_exl2

Text Generation • Updated Aug 26, 2024 • 6

RichardErkhov/mistralai_-_Mistral-7B-v0.1-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 5

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.1-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 23

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.2-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 5

RichardErkhov/google_-_codegemma-7b-it-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 29

RichardErkhov/google_-_codegemma-7b-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 29

LoneStriker/bagel-7b-v0.5-8.0bpw-h8-exl2

Text Generation • Updated Apr 14, 2024 • 7

mkeohane01/mistral-instruct-590

7B • Updated Apr 18, 2024

RichardErkhov/google_-_codegemma-2b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 24

RichardErkhov/databricks_-_dolly-v2-7b-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v2-3b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 6

RichardErkhov/databricks_-_dolly-v2-12b-8bits

Text Generation • 12B • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v1-6b-8bits

Text Generation • 6B • Updated Apr 14, 2024 • 7

cackerman/rewrites_gem7unsloth_4bit_ft_full_merged

Text Generation • 5B • Updated Apr 14, 2024 • 4

yongsun-shim/eeve-8bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 5

alpindale/Mistral-7B-Instruct-v0.2-EETQ

Text Generation • 7B • Updated Apr 15, 2024 • 6

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 4

shrenikb/sparseLAMA

Text Generation • 7B • Updated Apr 15, 2024 • 7

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 5

RichardErkhov/HuggingFaceH4_-_starchat-beta-8bits

Text Generation • 16B • Updated May 1, 2024 • 5

RichardErkhov/HuggingFaceH4_-_starchat-alpha-8bits

Text Generation • 16B • Updated May 1, 2024 • 7

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • 7B • Updated Apr 15, 2024 • 104k • 83

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • 141B • Updated Apr 16, 2024 • 684 • 129

khursani8/model

Text Generation • 2B • Updated Apr 16, 2024 • 10

PranavBP525/slava

2B • Updated Apr 21, 2024 • 3

Dracones/CodeQwen1.5-7B-Chat_exl2_8.0bpw

Text Generation • Updated Apr 16, 2024 • 8 • 4

Dracones/CodeQwen1.5-7B_exl2_8.0bpw

Text Generation • Updated Apr 16, 2024 • 8 • 1

grimjim/kukulemon-spiked-9B-8.0bpw_h8_exl2

Text Generation • Updated Aug 26, 2024 • 6

FriendliAI/Mixtral-8x7B-Instruct-v0.1-fp8

Text Generation • 47B • Updated Apr 18, 2024 • 11

FriendliAI/c4ai-command-r-plus-fp8

Text Generation • 107B • Updated Apr 19, 2024 • 5 • 5