Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,960

Base only

Active filters: bitsandbytes

RichardErkhov/GroNLP_-_gpt2-small-italian-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 11

RichardErkhov/GroNLP_-_gpt2-small-italian-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 14

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-4bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 10

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-8bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 10

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-4bits

Text Generation • 1B • Updated Apr 17, 2024 • 10

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-8bits

Text Generation • 1B • Updated Apr 17, 2024 • 11

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-4bits

Text Generation • 3B • Updated Apr 17, 2024 • 12

RichardErkhov/KoboldAI_-_fairseq-dense-125M-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9

RichardErkhov/KoboldAI_-_fairseq-dense-125M-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 12

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-8bits

Text Generation • 3B • Updated Apr 17, 2024 • 13

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-4bits

Text Generation • 3B • Updated Apr 17, 2024 • 10

RichardErkhov/KoboldAI_-_fairseq-dense-355M-4bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 9

RichardErkhov/KoboldAI_-_fairseq-dense-355M-8bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 10

RichardErkhov/LorenzoDeMattei_-_GePpeTto-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 8

RichardErkhov/LorenzoDeMattei_-_GePpeTto-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 20

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-8bits

Text Generation • 3B • Updated Apr 17, 2024 • 11

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-4bits

Text Generation • 82.6M • Updated Apr 17, 2024 • 10

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-4bits

Text Generation • 82.6M • Updated Apr 17, 2024 • 12

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-8bits

Text Generation • 82M • Updated Apr 17, 2024 • 9

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-8bits

Text Generation • 81.9M • Updated Apr 17, 2024 • 12

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 10

RichardErkhov/abinayam_-_gpt-2-tamil-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9

RichardErkhov/abinayam_-_gpt-2-tamil-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 11

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 10

RichardErkhov/akahana_-_gpt2-indonesia-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9 • 1

RichardErkhov/akahana_-_gpt2-indonesia-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9 • 1

RichardErkhov/akhooli_-_gpt2-small-arabic-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 16

RichardErkhov/akhooli_-_gpt2-small-arabic-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 14 • 1

RichardErkhov/antoinelouis_-_belgpt2-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9

RichardErkhov/antoinelouis_-_belgpt2-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9