Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,587

Base only

Active filters: 8-bit

JayhC/L3_SnowStorm_4x8B-8bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 6 • 1

Sirawipa/tian-ft8bit

7B • Updated May 23, 2024 • 4

cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ-8b

Text Generation • Updated May 29, 2024 • 5 • 1

cortecs/Meta-Llama-3-70B-Instruct-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 4

lucasvw/tinyllama-1.1B_alpaca_2k_lora

Updated May 23, 2024 • 6

gbueno86/Meta-LLama-3-Cat-A-LLama-70b-exl2-8.0bpw

Text Generation • Updated May 25, 2024 • 4 • 1

LoneStriker/aya-23-8B-8.0bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 7

MaziyarPanahi/calme-2.1-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 1.1k • 1

LoneStriker/aya-23-35B-8.0bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 8 • 2

MaziyarPanahi/calme-2.2-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 1.24k • 2

imdeadinside410/Llama-2-Academic-Advising

Updated Jun 1, 2024 • 4

MaziyarPanahi/calme-2.3-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 349 • 5

BigHuggyD/failspy_Llama-3-70B-Instruct-abliterated-v3-8.0bpw-h8-exl2

Text Generation • Updated May 24, 2024 • 11 • 1

Zoyd/CohereForAI_aya-23-35B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3

Jon-Biz/axolotl

Updated May 24, 2024 • 4

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 4 • 1

Zoyd/CohereForAI_aya-23-8B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3 • 1

Zoyd/RESMPDEV_Qwen1.5-Wukong-1.8B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3

gbueno86/Meta-LLama-3-Cat-Smaug-LLama-70b-exl2-8.0bpw

Text Generation • Updated May 24, 2024 • 4

Zoyd/Sao10K_L3-8B-Stheno-v3.1-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5 • 3

sahanes/TinyLlamaB_alpaca_2k

Updated May 24, 2024 • 6

Zoyd/Nanbeige_Nanbeige2-16B-Chat-8_0bpw_exl2

Question Answering • Updated May 24, 2024 • 3

AlanFeder/lora-out

Updated May 24, 2024 • 2

vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2

Text Generation • Updated May 25, 2024 • 3 • 1

AayushMathur/manim-codellama-7b

Updated May 24, 2024 • 8 • 2

altomek/Granite-20B-Code-Instruct-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 6

AAProject/Llama-2-7b-chat-hf-8bits-bnb

Text Generation • 7B • Updated May 24, 2024 • 4

Zoyd/x2bee_POLAR-14B-DPO-v1.3-8_0bpw_exl2

Text Generation • Updated May 25, 2024 • 9

Zoyd/shisa-ai_shisa-v1-phi3-14b-8_0bpw_exl2

Text Generation • Updated May 25, 2024 • 4

Zoyd/mlabonne_Meta-Llama-3-12B-Instruct-8_0bpw_exl2

Text Generation • Updated May 25, 2024 • 4