Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,393

Base only

Active filters: bitsandbytes

kaidens/WHaK_AIv1

Updated Apr 15, 2024 • 2

Ekhlass/phi2-flutter-q-docs

Text Generation • 3B • Updated Apr 14, 2024 • 4

RichardErkhov/google_-_codegemma-2b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 7

RichardErkhov/google_-_codegemma-2b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 4

daanjiri/Biomistral_7b_bhc_10

Text Generation • Updated Apr 14, 2024 • 4

RichardErkhov/databricks_-_dolly-v2-7b-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-7b-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-3b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-3b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-12b-4bits

Text Generation • 12B • Updated Apr 14, 2024 • 2

RichardErkhov/databricks_-_dolly-v1-6b-4bits

Text Generation • 6B • Updated Apr 14, 2024 • 2

Imadken/Mistral-7B-v0.1-platypus

Text Generation • Updated Apr 15, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-12b-8bits

Text Generation • 12B • Updated Apr 14, 2024 • 4

RichardErkhov/databricks_-_dolly-v1-6b-8bits

Text Generation • 6B • Updated Apr 14, 2024 • 2

akumar23/mental-falcon-7b

Text Generation • Updated Apr 15, 2024 • 3

sosoai/unsloth-hansoldeco-mistral-7b-openhermes-mixed-lora-v0.1

Text Generation • 7B • Updated Apr 14, 2024 • 2

jhamel/rebel_fine_tune

Text Generation • 0.3B • Updated Apr 15, 2024 • 4

EdBerg/quotes_Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 14, 2024 • 4

yongsun-shim/eeve-8bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 3

ai-er/llama-2-medi-dialog-mini-finetuned

Text Generation • 7B • Updated Apr 15, 2024 • 3

yongsun-shim/eeve-4bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 1

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 3

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 3

shrenikb/sparseLAMA

Text Generation • 7B • Updated Apr 15, 2024 • 3

yongsun-shim/eeve-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 3

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 1

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 1

yongsun-shim/eeve-4bit-test-3

Text Generation • 11B • Updated Apr 15, 2024 • 3

yongsun-shim/solar-4bit-test-1

Text Generation • 11B • Updated Apr 15, 2024 • 3

yongsun-shim/solar-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 3