Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,974

Base only

Active filters: bitsandbytes

RichardErkhov/google_-_codegemma-2b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 33

RichardErkhov/google_-_codegemma-2b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 29

daanjiri/Biomistral_7b_bhc_10

Text Generation • Updated Apr 14, 2024 • 6

RichardErkhov/databricks_-_dolly-v2-7b-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 11

RichardErkhov/databricks_-_dolly-v2-7b-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 11

RichardErkhov/databricks_-_dolly-v2-3b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 11

RichardErkhov/databricks_-_dolly-v2-3b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 11

RichardErkhov/databricks_-_dolly-v2-12b-4bits

Text Generation • 12B • Updated Apr 14, 2024 • 13

RichardErkhov/databricks_-_dolly-v1-6b-4bits

Text Generation • 6B • Updated Apr 14, 2024 • 13

Imadken/Mistral-7B-v0.1-platypus

Text Generation • Updated Apr 15, 2024 • 8

RichardErkhov/databricks_-_dolly-v2-12b-8bits

Text Generation • 12B • Updated Apr 14, 2024 • 17

RichardErkhov/databricks_-_dolly-v1-6b-8bits

Text Generation • 6B • Updated Apr 14, 2024 • 19

akumar23/mental-falcon-7b

Text Generation • Updated Apr 15, 2024 • 10

sosoai/unsloth-hansoldeco-mistral-7b-openhermes-mixed-lora-v0.1

Text Generation • 7B • Updated Apr 14, 2024 • 8

jhamel/rebel_fine_tune

Text Generation • 0.3B • Updated Apr 15, 2024 • 11

EdBerg/quotes_Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 14, 2024 • 7

yongsun-shim/eeve-8bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 9

ai-er/llama-2-medi-dialog-mini-finetuned

Text Generation • 7B • Updated Apr 15, 2024 • 6

yongsun-shim/eeve-4bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 10

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 6

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 8

yongsun-shim/eeve-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 9

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 8

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 8

yongsun-shim/eeve-4bit-test-3

Text Generation • 11B • Updated Apr 15, 2024 • 9

yongsun-shim/solar-4bit-test-1

Text Generation • 11B • Updated Apr 15, 2024 • 9

yongsun-shim/solar-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 9

RichardErkhov/HuggingFaceH4_-_starchat-beta-4bits

Text Generation • 16B • Updated May 1, 2024 • 17

RichardErkhov/HuggingFaceH4_-_starchat-beta-8bits

Text Generation • 16B • Updated May 1, 2024 • 12

rahulvramesh/tinyllama-colorist-v1

Text Generation • 1B • Updated Apr 15, 2024 • 8