Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,669

Base only

Active filters: 8-bit

RichardErkhov/deepset_-_xlm-roberta-large-squad2-8bits

Text Generation • 0.6B • Updated May 2, 2024 • 4

RichardErkhov/Andron00e_-_YetAnother_Open-Llama-3B-LoRA-OpenOrca-8bits

Text Generation • 3B • Updated May 2, 2024 • 4

Shaleen123/llama3-code-8bit-merged

Text Generation • 8B • Updated May 2, 2024 • 5

RichardErkhov/julleong_-_illuni-llama-2-ko-7b-test-8bits

Text Generation • 7B • Updated May 2, 2024 • 3

RichardErkhov/Felladrin_-_Llama-68M-Chat-v1-8bits

Text Generation • 68.1M • Updated May 2, 2024 • 3

MaziyarPanahi/calme-2.4-llama3-70b-GGUF

Text Generation • 71B • Updated Jul 20, 2024 • 5.9k • 9

RichardErkhov/berkeley-nest_-_Starling-LM-7B-alpha-8bits

Text Generation • 7B • Updated May 2, 2024 • 3

RichardErkhov/google_-_gemma-7b-it-8bits

Text Generation • 9B • Updated May 2, 2024 • 2

MaziyarPanahi/calme-2.3-llama3-70b-GGUF

Text Generation • 71B • Updated Jul 20, 2024 • 1.76k • 1

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4-GGUF

Text Generation • 8B • Updated May 4, 2024 • 32 • 3

RichardErkhov/h2oai_-_h2ogpt-4096-llama2-7b-chat-8bits

Text Generation • 7B • Updated May 2, 2024 • 4

RichardErkhov/deepseek-ai_-_deepseek-math-7b-rl-8bits

Text Generation • 7B • Updated May 2, 2024 • 4

RichardErkhov/daekeun-ml_-_phi-2-ko-v0.1-8bits

Text Generation • 3B • Updated May 2, 2024 • 6

kishorea/P8_Llama3_base

Text Generation • 8B • Updated May 20, 2024 • 7

RichardErkhov/Maykeye_-_TinyLLama-v0-8bits

Text Generation • 4.63M • Updated May 2, 2024 • 6

kishorea/P-Llama70B

Text Generation • 71B • Updated May 2, 2024 • 5

RichardErkhov/FlagAlpha_-_Atom-7B-Chat-8bits

Text Generation • 7B • Updated May 2, 2024 • 2

RichardErkhov/huggyllama_-_llama-7b-8bits

Text Generation • 7B • Updated May 2, 2024 • 4

RichardErkhov/codellama_-_CodeLlama-7b-hf-8bits

Text Generation • 7B • Updated May 2, 2024 • 5

MaziyarPanahi/calme-2.2-llama3-70b-GGUF

Text Generation • 71B • Updated Jul 20, 2024 • 4.75k • 2

RichardErkhov/teknium_-_OpenHermes-2.5-Mistral-7B-8bits

Text Generation • 7B • Updated May 2, 2024 • 4

LoneStriker/Llama3-ChatQA-1.5-8B-8.0bpw-h8-exl2

Text Generation • Updated May 2, 2024 • 3

atcsecure/dolphin-2.9-llama3-70b-8.0bpw-h8-exl2

Text Generation • Updated May 2, 2024 • 5 • 2

RichardErkhov/TinyLlama_-_TinyLlama-1.1B-intermediate-step-1431k-3T-8bits

Text Generation • 1B • Updated May 3, 2024 • 4

RichardErkhov/amichalski2_-_tinyllama-email-model-full-8bits

Text Generation • 1B • Updated May 3, 2024 • 6

RichardErkhov/codellama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated May 3, 2024 • 4

RichardErkhov/upstage_-_SOLAR-10.7B-Instruct-v1.0-8bits

Text Generation • 11B • Updated May 3, 2024 • 3

RichardErkhov/fxmarty_-_tiny-random-GemmaForCausalLM-8bits

Text Generation • 8.19M • Updated May 3, 2024 • 4

RichardErkhov/mlabonne_-_NeuralDaredevil-7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 3

RichardErkhov/FlagAlpha_-_Atom-7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 4