Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,386

Base only

Active filters: bitsandbytes

sosoai/hansoldeco-Mixtral-8x22B-Instruct-v1

Text Generation • 143B • Updated Apr 21, 2024 • 2

appvoid/instruct-palmer-003-beta-4

Text Generation • 1B • Updated Apr 18, 2024 • 3

gildead/mistral-aes-966

Text Generation • 7B • Updated Apr 18, 2024 • 4

gildead/mistral-aes-414

Text Generation • 7B • Updated Apr 18, 2024 • 3

thanhnew2001/bank5

Text Generation • 0.6B • Updated Apr 18, 2024 • 3

abdullahfurquan/merged_final

Text Generation • 7B • Updated Apr 18, 2024 • 4

areegtarek/llmcxr_mimic-4bit

Text Generation • Updated Apr 18, 2024 • 2

areegtarek/llmcxr_mimic-8bit

Text Generation • Updated Apr 18, 2024 • 4

areegtarek/llmcxr_mimic-8bit-v1

Text Generation • Updated Apr 18, 2024 • 4

areegtarek/llmcxr_mimic-4bit-v1

Text Generation • Updated Apr 18, 2024 • 4

daveydhruti/mistral-based-NIDS

Updated Apr 18, 2024 • 6 • 1

daveydhruti/Llama2-based-NIDS

Updated Apr 18, 2024 • 2

AlekHesa/testing-llama2-v5

Text Generation • 7B • Updated Apr 20, 2024 • 6

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • 8B • Updated Nov 22, 2024 • 55.3k • 134

Pot-l/mistral-7b-bnb-4bit-full-QA

Text Generation • 7B • Updated Apr 18, 2024 • 4

ibibek/Meta-Llama-3-8B-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 4

ibibek/Meta-Llama-3-8B-Instruct-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 3 • 2

Truepeak/NeuralHermes-2.5-Mistral-7B

Text Generation • 7B • Updated Apr 18, 2024 • 8

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 334 • 50

havvanilsu/gemma-7b-Finance_v1000_model

Text Generation • 9B • Updated Apr 18, 2024 • 4

corneille97/Llama-3-8B-4bits-turbo

Text Generation • 8B • Updated Apr 18, 2024 • 1

prince-canuma/Meta-Llama-3-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 1

Pot-l/mistral-7b-bnb-4bit-QA-merged

Text Generation • 7B • Updated Apr 18, 2024 • 3

prince-canuma/Meta-Llama-3-8B-bnb-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 1

LoftQ/Meta-Llama-3-8B-4bit-64rank

Text Generation • 8B • Updated May 3, 2024 • 7 • 2

LoftQ/CodeLlama-7b-hf-4bit-64rank

Text Generation • 7B • Updated Apr 20, 2024 • 4

LoftQ/CodeLlama-13b-hf-4bit-64rank

Text Generation • 13B • Updated Apr 20, 2024 • 2

ZachX/UltraMerge-v2-7B

Text Generation • 7B • Updated Apr 19, 2024 • 4

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • 8B • Updated Apr 21, 2024 • 3 • 1

OnlyCheeini/alpaca-llama3-8b

Text Generation • 8B • Updated Apr 19, 2024 • 5