Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,380

Base only

Active filters: bitsandbytes

RichardErkhov/HuggingFaceH4_-_zephyr-7b-alpha-8bits

Text Generation • 7B • Updated May 1, 2024 • 6

RichardErkhov/HuggingFaceH4_-_zephyr-7b-beta-4bits

Text Generation • 7B • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_zephyr-7b-beta-8bits

Text Generation • 7B • Updated May 1, 2024 • 3

RichardErkhov/HuggingFaceH4_-_mistral-7b-grok-4bits

Text Generation • 7B • Updated May 1, 2024 • 8

RichardErkhov/HuggingFaceH4_-_mistral-7b-grok-8bits

Text Generation • 7B • Updated May 1, 2024 • 4

nuebaek/komt_mistral_mss_generation

Text Generation • 7B • Updated May 1, 2024 • 4

nuebaek/komt_mistral_insta_generation

Text Generation • 7B • Updated May 1, 2024 • 4

RichardErkhov/HuggingFaceH4_-_mistral-7b-anthropic-4bits

Text Generation • 7B • Updated May 1, 2024 • 33

RichardErkhov/HuggingFaceH4_-_mistral-7b-anthropic-8bits

Text Generation • 7B • Updated May 1, 2024 • 33

RichardErkhov/HuggingFaceH4_-_zephyr-7b-gemma-sft-v0.1-4bits

Text Generation • 9B • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_zephyr-7b-gemma-sft-v0.1-8bits

Text Generation • 9B • Updated May 1, 2024 • 3

RichardErkhov/HuggingFaceH4_-_zephyr-7b-gemma-v0.1-4bits

Text Generation • 9B • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_zephyr-7b-gemma-v0.1-8bits

Text Generation • 9B • Updated May 1, 2024 • 5

RichardErkhov/HuggingFaceH4_-_starchat2-15b-v0.1-4bits

Text Generation • 16B • Updated May 1, 2024 • 4

wttw/Llama3-8B-CPP

Text Generation • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_starchat2-15b-v0.1-8bits

Text Generation • 16B • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_starchat2-15b-sft-v0.1-4bits

Text Generation • 16B • Updated May 1, 2024 • 2

RichardErkhov/HuggingFaceH4_-_starchat2-15b-sft-v0.1-8bits

Text Generation • 16B • Updated May 1, 2024 • 2

theGhoul21/srl-sft-010524-4bit

Text Generation • 7B • Updated May 1, 2024 • 3

kloodia/llama-8x8-qlora-alpaca

Updated May 1, 2024

gen-bi/llama-2-ko-juno-7b

Text Generation • 7B • Updated May 1, 2024 • 4

neph1/llama-3-instruct-bellman-8b-swedish

Text Generation • 8B • Updated Jul 24, 2024 • 212 • 2

RichardErkhov/ABX-AI_-_Spicy-Laymonade-7B-4bits

Text Generation • 7B • Updated May 1, 2024 • 2

RichardErkhov/RobertML_-_sn6e-4bits

Text Generation • 2B • Updated May 1, 2024 • 5

RichardErkhov/RobertML_-_sn6e-8bits

Text Generation • 2B • Updated May 1, 2024 • 5

RichardErkhov/Undi95_-_Llama-3-Unholy-8B-4bits

Text Generation • 8B • Updated May 1, 2024 • 2

RichardErkhov/ABX-AI_-_Spicy-Laymonade-7B-8bits

Text Generation • 7B • Updated May 1, 2024 • 2

RichardErkhov/Undi95_-_Llama-3-Unholy-8B-8bits

Text Generation • 8B • Updated May 1, 2024 • 2

rachid16/llama3-8b-RAG-News-Finance

Text Generation • Updated May 4, 2024 • 3

RichardErkhov/CreitinGameplays_-_bloom-3b-conversational-4bits

Text Generation • 3B • Updated May 1, 2024 • 11