Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,682

Base only

Active filters: 8-bit

LoneStriker/OrpoLlama-3-8B-8.0bpw-h8-exl2

Text Generation • Updated Apr 21, 2024 • 6

LoneStriker/dolphin-2.9-llama3-8b-8.0bpw-h8-exl2

Text Generation • Updated Apr 21, 2024 • 9 • 1

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 6

astronomer/Llama-3-8B-GPTQ-8-Bit

Text Generation • 8B • Updated Apr 22, 2024 • 9 • 3

KvrParaskevi/Llama-2-7b-Hotel-Booking-Model-8Bit

Text Generation • 7B • Updated May 16, 2024 • 8

failspy/InternVL-Chat-V1-5-8bit

Visual Question Answering • 26B • Updated Apr 22, 2024 • 22 • 2

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated May 2, 2024 • 4

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated May 2, 2024 • 5

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-8bits

Text Generation • 8B • Updated Apr 22, 2024 • 4

kevin009/llama3math-s90

5B • Updated Apr 22, 2024 • 16

yujiepan/Meta-Llama-3-8B-gptq-w8asym

Text Generation • 8B • Updated Apr 22, 2024 • 4

JeromeMore/Meta-Llama-3-8B-Instruct-bnb_8bit

Text Generation • 8B • Updated Apr 22, 2024 • 3

hanzogak/Llama-3-Soliloquy-8B-exl2-h8-8.0

Text Generation • Updated Apr 22, 2024 • 3 • 3

yujiepan/Meta-Llama-3-8B-Instruct-gptq-w8asym

Text Generation • 8B • Updated Apr 22, 2024 • 4

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-base-8bits

Text Generation • 7B • Updated Apr 22, 2024 • 6

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-instruct-8bits

Text Generation • 7B • Updated Apr 22, 2024 • 3

RichardErkhov/deepseek-ai_-_deepseek-coder-33b-base-8bits

Text Generation • 33B • Updated Apr 23, 2024 • 4

llama-lang-adapt/AfriInstruct-Model

Updated Apr 22, 2024 • 3

LoneStriker/Llama-3-8B-16K-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 6

LoneStriker/Llama3-8B-Chinese-Chat-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 6

RichardErkhov/EleutherAI_-_polyglot-ko-3.8b-8bits

Text Generation • 4B • Updated Apr 23, 2024 • 3

RichardErkhov/EleutherAI_-_polyglot-ko-1.3b-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 3

RichardErkhov/EleutherAI_-_gpt-neox-20b-8bits

Text Generation • 21B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_polyglot-ko-5.8b-8bits

Text Generation • 6B • Updated Apr 23, 2024 • 7

RichardErkhov/EleutherAI_-_pythia-160m-v0-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 5

RichardErkhov/EleutherAI_-_pythia-1b-v0-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_polyglot-ko-12.8b-8bits

Text Generation • 13B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-70m-v0-8bits

Text Generation • 70.5M • Updated Apr 23, 2024 • 5