Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33,345

Base only

Active filters: 8-bit

polmeladianos/oasst-sft-4-pythia-12b-epoch-3.5m-8bit

Text Generation • Updated May 6, 2023 • 5

universonic/llama-7b-8bit

Text Generation • 7B • Updated Sep 22, 2023 • 7

santhosh97/eleuther-gpt-j-6B

Text Generation • Updated May 10, 2023 • 7

santhosh97/gpt-pythia-6.9b-quantized

Text Generation • Updated May 10, 2023 • 5

santhosh97/gpt-mosaic-int8

Text Generation • Updated May 10, 2023 • 7

santhosh97/gpt-mosaic-7b-int8

Text Generation • Updated May 10, 2023 • 7

santhosh97/gpt-pythia-12b-quantized

Text Generation • Updated May 11, 2023 • 6

ladygaia/alpaca-8bit

Text Generation • Updated May 15, 2023 • 5

jasonmcaffee/flan-t5-large-samsum

Updated May 17, 2023 • 4 • 2

WHJ1998/stablelm-7b-sft-v7-epoch-3-int8

Text Generation • Updated May 17, 2023 • 7

WHJ1998/oasst-sft-4-pythia-12b-epoch-int8

Text Generation • Updated May 17, 2023 • 8

WHJ1998/oasst-sft-4-pythia-12b-epoch-int8-1GB

Text Generation • Updated May 17, 2023 • 9

reasonwang/flan-t5-xl-8bit

Updated May 18, 2023 • 8

devanand7800/pygmalion-1.3b

Text Generation • Updated May 19, 2023 • 5

zh-tw-llm-dv/zh-tw-llm-ta01-pythia-6.9b-ta8000-v1-a_1_embeddings-h100-t01-c5daa1-8bit

Text Generation • Updated May 19, 2023 • 5

zetavg/zh-tw-llm-ta01-pythia-6.9b-ta8000-v1-a_1_embeddings-h100-t01-c5daa1-8bit-2

Text Generation • Updated May 19, 2023 • 6

Chauhanhp10/test2

Text Generation • Updated May 20, 2023 • 5

WHJ1998/Ziya-LLaMA-13B-v1-in8

Text Generation • Updated Jun 11, 2023 • 6

Shoubhik8/bloom-1b7-no_lora-finetuned_v2

Text Generation • Updated May 24, 2023 • 5

Grammonde/dolly-v2-meadow-patient-info-fine-tune

Text Generation • Updated May 26, 2023 • 4

RajuKandasamy/twinsights_3b_alpha_8bit

Text Generation • Updated May 26, 2023 • 7

rockerBOO/stablelm-tuned-alpha-3b-8bit

Text Generation • 4B • Updated Sep 6, 2024 • 12 • 3

kyo-takano/open-calm-7b-8bit

Text Generation • Updated May 28, 2023 • 13 • 10

pythainlp/wangchanglm-7.5B-sft-en-8bit

Text Generation • Updated May 29, 2023 • 10

pythainlp/wangchanglm-7.5B-sft-en-8bit-sharded

Text Generation • Updated May 31, 2023 • 6

legendhasit/gpt-j-8-bit

Text Generation • Updated May 29, 2023 • 7

rycont/kakaobrain__kogpt-6b-8bit

Text Generation • Updated May 30, 2023 • 8 • 2

beomi/polyglot-ko-12.8b-safetensors-8bit

Text Generation • 13B • Updated May 31, 2023 • 12 • 2

exbow/TinyStories-wikitrain-33m-ethan-8bit

Text Generation • Updated Jun 1, 2023 • 16

Sandiago21/llama-13b-hf-prompt-answering

Text Generation • 13B • Updated Feb 8, 2025 • 44 • 1