Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,959

Base only

Active filters: bitsandbytes

RichardErkhov/EleutherAI_-_pythia-410m-4bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-410m-8bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 11

RichardErkhov/EleutherAI_-_pythia-410m-deduped-4bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-410m-deduped-8bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_pythia-2.8b-8bits

Text Generation • 3B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-1b-deduped-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-160m-seed1-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 12

RichardErkhov/EleutherAI_-_pythia-160m-seed1-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 11

RichardErkhov/EleutherAI_-_pythia-1b-deduped-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_pythia-160m-seed2-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 11

RichardErkhov/EleutherAI_-_pythia-160m-seed2-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-160m-seed3-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 11

RichardErkhov/EleutherAI_-_pythia-14m-4bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-14m-8bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_pythia-160m-seed3-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 14

RichardErkhov/EleutherAI_-_pythia-1b-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 10

RichardErkhov/EleutherAI_-_pythia-31m-4bits

Text Generation • 30.6M • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_pythia-31m-8bits

Text Generation • 30.5M • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_pythia-1b-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 9

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-4bits

Text Generation • 7B • Updated Apr 23, 2024 • 12

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-8bits

Text Generation • 7B • Updated Apr 23, 2024 • 7

guptasaurabh78/ph2-sau-samsum-ft-2

Text Generation • 3B • Updated Apr 23, 2024 • 7

hikikomoriHaven/llama3-8b-hikikomori-v0.3

Text Generation • Updated Apr 25, 2024 • 7 • 3

ale-bay/distral-7b-v1

Updated May 22, 2024 • 5

yeelou/design2code-hf-bit4

Text Generation • Updated Apr 25, 2024 • 9

screevoai/llama3-70b-instruct-4bit

Text Generation • 73B • Updated Apr 23, 2024 • 12 • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Jun 8, 2024 • 12 • 6

leliuga/Phi-3-mini-128k-instruct-bnb-4bit

Text Generation • 4B • Updated Apr 23, 2024 • 10 • 1

martimfasantos/tinyllama-1.1b-chat-dpo-qlora

Updated Apr 24, 2024 • 11

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • 7B • Updated Apr 24, 2024 • 10 • 4