Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33,327

Base only

Active filters: 8-bit

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 8 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 17 • 1

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 6 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • 8B • Updated Nov 19, 2023 • 13 • 3

osiria/primo

Text Generation • Updated Aug 12, 2023 • 63 • 2

vivym/chatglm2-6b-int4

Text Generation • 3B • Updated Jul 27, 2023 • 11

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 11

Matsakitkat/Mobility_Future_expectation

Text Generation • Updated Aug 1, 2023 • 7

anhtunguyen98/flan-t5-xxl-8bit

Updated Jul 28, 2023 • 4

vivekraina/Llama-2-13b-chat-hf-8bit

Text Generation • Updated Jul 28, 2023 • 8

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • 14B • Updated Nov 19, 2023 • 113

TransformerTales/llama-2-7b-8bit-nested

Text Generation • Updated Aug 5, 2023 • 6 • 2

legendhasit/xgen-7b-8k-open-instruct-8bit

Text Generation • Updated Jul 31, 2023 • 6

Harshvir/LaMini-Neo-1.3B-Mental-Health_lora

Text Generation • Updated Jul 31, 2023 • 47 • 2

manojkumarvohra/llama2-7B-8bit-guanaco-pico-finetuned

Text Generation • Updated Aug 1, 2023 • 7

valhalla/muse-laiona5-oai-clip-384res-8bit

Updated Aug 1, 2023 • 4

snigdhachandan/gtr_large_8bit

Feature Extraction • Updated Aug 3, 2023 • 5

Mursel/redpj3B-lora-int8-alpaca

Updated Aug 3, 2023 • 15

Harshvir/open_llama_3b-Physics

Text Generation • Updated Aug 10, 2023 • 6

Mediocreatmybest/DocsGPT-7B_8bit

Text Generation • Updated Aug 6, 2023 • 8

quantumaikr/llama-2-7B-8bit-guanaco-llama2-1k

Text Generation • Updated Aug 6, 2023 • 7

Baekpica/vicuna-7b-v1.3-tiny-stories-pretraining-2epoch

Text Generation • Updated Aug 7, 2023 • 9

Mediocreatmybest/WizardCoder-15B-V1.0_8bit

Text Generation • Updated Aug 7, 2023 • 15

Baekpica/vicuna-7b-v1.3-tinystories-linear

Text Generation • Updated Aug 7, 2023 • 6

Mediocreatmybest/instructblip-flan-t5-xl_8bit

Image-to-Text • 4B • Updated Nov 20, 2023 • 18 • 1

Mediocreatmybest/instructblip-flan-t5-xxl_8bit

Image-to-Text • 12B • Updated Nov 20, 2023 • 7

diingli/baichuan-13b-half-8bit

Text Generation • Updated Aug 9, 2023 • 6

Rupak100/Error_correction

Updated Aug 9, 2023 • 4

joaogante/tiny-random-gpt2-with-generation-config

2.85M • Updated Mar 7, 2024 • 19.3k

realzdlegend/Llama-2-13b-chat-8bit

Text Generation • Updated Aug 9, 2023 • 5