Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,308

Base only

Active filters: 8-bit

byoussef/whisper-large-v2-ko-PEFT

Automatic Speech Recognition • 2B • Updated Aug 25, 2025 • 5

BreadAi/MuseCan-1-2

Text Generation • 0.2B • Updated Aug 5, 2023 • 6

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 14

ybelkada/bloom-1b7-8bit

Text Generation • 2B • Updated Apr 17, 2023 • 130 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 3

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 7

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 5

KumaTea/twitter-int8

Feature Extraction • 6B • Updated Feb 8, 2025 • 51

KumaTea/twitter-int4

Feature Extraction • 3B • Updated Feb 8, 2025 • 55 • 1

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023 • 2

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 9

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 12

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 10

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 5 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 32 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 10

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 6

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 10

Linus4Lyf/Llama-10epoch-Plato-3epoch-Kant_Metaphysics_Of_Morals

Text Generation • Updated Apr 26, 2023 • 6 • 1

emrik/bloom7b-vigogne

Text Generation • Updated Apr 26, 2023 • 3

Linus4Lyf/Llama-10epoch-Plato-3epoch-Rousseau_Emile

Text Generation • Updated Apr 27, 2023 • 8

Linus4Lyf/Llama-10epoch-Plato-3epoch-Sina_A_Compendium_On_The_Soul

Text Generation • Updated Apr 27, 2023 • 8

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • 3B • Updated Dec 29, 2025 • 7

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 5 • 2

Sepehrasg/sepi-lora

Text Generation • Updated Apr 28, 2023 • 3

Linus4Lyf/Llama-10epoch-Plato-3epoch-Wollstonecraft_Thoughts_On_The_Education_Of_Daughters

Text Generation • Updated Apr 28, 2023 • 7

ek826/instruct-gpt-j-fp16-8bit

Text Generation • Updated May 18, 2023 • 8

Ransaka/mbart-large-cc25-8bit

1B • Updated Oct 2, 2023 • 4

alexpaul/QI-Large-v1

Text Generation • Updated May 1, 2023 • 7

rsonavane/flan-t5-xl-alpaca-dolly-lora-peft

Text Generation • Updated May 5, 2023 • 9 • 1