Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33,357

Base only

Active filters: 8-bit

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 7

KumaTea/twitter-int8

Feature Extraction • 6B • Updated Feb 8, 2025 • 107

KumaTea/twitter-int4

Feature Extraction • 3B • Updated Feb 8, 2025 • 107 • 1

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023 • 2

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 9

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 9

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 9

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 15 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 12 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 13

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 9

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 6

Linus4Lyf/Llama-10epoch-Plato-3epoch-Kant_Metaphysics_Of_Morals

Text Generation • Updated Apr 26, 2023 • 6 • 1

emrik/bloom7b-vigogne

Text Generation • Updated Apr 26, 2023 • 6

Linus4Lyf/Llama-10epoch-Plato-3epoch-Rousseau_Emile

Text Generation • Updated Apr 27, 2023 • 9

Linus4Lyf/Llama-10epoch-Plato-3epoch-Sina_A_Compendium_On_The_Soul

Text Generation • Updated Apr 27, 2023 • 8

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • 3B • Updated Dec 29, 2025 • 9

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 19 • 2

Sepehrasg/sepi-lora

Text Generation • Updated Apr 28, 2023 • 4

Linus4Lyf/Llama-10epoch-Plato-3epoch-Wollstonecraft_Thoughts_On_The_Education_Of_Daughters

Text Generation • Updated Apr 28, 2023 • 7

ek826/instruct-gpt-j-fp16-8bit

Text Generation • Updated May 18, 2023 • 12

Ransaka/mbart-large-cc25-8bit

1B • Updated Oct 2, 2023 • 4

alexpaul/QI-Large-v1

Text Generation • Updated May 1, 2023 • 9

rsonavane/flan-t5-xl-alpaca-dolly-lora-peft

Text Generation • Updated May 5, 2023 • 63 • 1

MrNJK/gpt2-xl-sft-int8

Text Generation • Updated May 5, 2023 • 7

polmeladianos/oasst-sft-4-pythia-12b-epoch-3.5m-8bit

Text Generation • Updated May 6, 2023 • 5

universonic/llama-7b-8bit

Text Generation • 7B • Updated Sep 22, 2023 • 7

santhosh97/eleuther-gpt-j-6B

Text Generation • Updated May 10, 2023 • 7

santhosh97/gpt-pythia-6.9b-quantized

Text Generation • Updated May 10, 2023 • 5

santhosh97/gpt-mosaic-int8

Text Generation • Updated May 10, 2023 • 7