Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,672

Base only

Active filters: 8-bit

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_8.0bpw

Text Generation • Updated Apr 26, 2024 • 5 • 3

MaziyarPanahi/calme-2.1-llama3-70b-GGUF

Text Generation • 71B • Updated Jul 20, 2024 • 277 • 4

Entreprenerdly/blip2-opt-2.7b-fp16-sharded

Visual Question Answering • 4B • Updated Apr 26, 2024 • 14 • 1

study-hjt/Qwen1.5-110B-Chat-GPTQ-Int8

Text Generation • 111B • Updated Apr 27, 2024 • 6

study-hjt/Qwen1.5-32B-Chat-GPTQ-Int8

Text Generation • 33B • Updated Apr 26, 2024 • 10 • 1

study-hjt/CodeQwen1.5-7B-Chat-GPTQ-Int8

Text Generation • 7B • Updated Apr 26, 2024 • 203 • 1

RichardErkhov/IlyaGusev_-_saiga_llama3_8b-8bits

Text Generation • 8B • Updated Apr 26, 2024 • 5

RichardErkhov/IlyaGusev_-_saiga_gemma_9b-8bits

Text Generation • 9B • Updated Apr 26, 2024 • 6

RichardErkhov/Nexusflow_-_Starling-LM-7B-beta-8bits

Text Generation • 7B • Updated Apr 26, 2024 • 5

LoneStriker/OpenBioLLM-Llama3-8B-8.0bpw-h8-exl2

Text Generation • Updated Apr 26, 2024 • 7

zaq-hack/Llama-3-LewdPlay-8B-evo-bpw800-h8-exl2-rpcal

Text Generation • Updated Apr 29, 2024 • 6 • 1

RichardErkhov/bigscience_-_bigscience-small-testing-8bits

Text Generation • 16.2M • Updated Apr 26, 2024 • 6

RichardErkhov/bigscience_-_bloom-560m-8bits

Text Generation • 0.6B • Updated Apr 26, 2024 • 4

o2satz/L3_med16QA

Text Generation • 8B • Updated Apr 26, 2024 • 8

RichardErkhov/bigscience_-_bloom-1b1-8bits

Text Generation • 1B • Updated Apr 26, 2024 • 4

RichardErkhov/bigscience_-_bloom-1b7-8bits

Text Generation • 2B • Updated May 2, 2024 • 5

RichardErkhov/bigscience_-_bloom-3b-8bits

Text Generation • 3B • Updated Apr 26, 2024 • 4

RichardErkhov/bigscience_-_bloom-7b1-8bits

Text Generation • 7B • Updated Apr 26, 2024 • 5

qworksadmin/llama2c1

Text Generation • 13B • Updated Apr 27, 2024 • 6

zaq-hack/Llama-3-LewdPlay-8B-evo-8bpw-exl2

Text Generation • Updated Apr 29, 2024 • 4 • 3

RichardErkhov/NousResearch_-_Genstruct-7B-8bits

Text Generation • 7B • Updated Apr 28, 2024 • 5

jasdeep06/llama-7b-samsum

Text Generation • 7B • Updated Apr 28, 2024 • 6

754geg/kpok

Text Generation • 141B • Updated Apr 28, 2024 • 13

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 4

dimakosttt/dziekanat2.0

Text Generation • Updated May 1, 2024 • 6

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 4

justinkarlin/idefics-9b-faces

Image-Text-to-Text • 5B • Updated May 1, 2024 • 6

RichardErkhov/facebook_-_galactica-125m-8bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 3

RichardErkhov/facebook_-_xglm-4.5B-8bits

Text Generation • 5B • Updated Apr 30, 2024 • 4

kloodia/lora-8b-code

Updated Apr 29, 2024 • 4