Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,598

Base only

Active filters: 8-bit

RichardErkhov/beberik_-_Nyxene-v2-11B-8bits

Text Generation • 11B • Updated May 22, 2024 • 6

RichardErkhov/maywell_-_Llama-3-Synatra-11B-v1-8bits

Text Generation • 12B • Updated May 22, 2024 • 4

RichardErkhov/Undi95_-_Mistral-11B-v0.1-8bits

Text Generation • 11B • Updated May 22, 2024 • 6

RichardErkhov/beberik_-_Nyxene-v3-11B-8bits

Text Generation • 11B • Updated May 22, 2024 • 4

CamiloVega/llama2-chatbot

Text Generation • Updated May 22, 2024 • 4

goutham0723/SQL-llama3-8B

Text Generation • Updated May 23, 2024 • 5

imdeadinside410/TestTrainedModel

Text Generation • Updated May 22, 2024 • 5

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 103k • 147

rubenamtz0/hc-mistral-alpaca

Updated May 23, 2024 • 4

JayhC/L3_SnowStorm_4x8B-8bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 6 • 1

Sirawipa/tian-ft8bit

7B • Updated May 23, 2024 • 4

cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ-8b

Text Generation • Updated May 29, 2024 • 5 • 1

cortecs/Meta-Llama-3-70B-Instruct-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 4

lucasvw/tinyllama-1.1B_alpaca_2k_lora

Updated May 23, 2024 • 6

gbueno86/Meta-LLama-3-Cat-A-LLama-70b-exl2-8.0bpw

Text Generation • Updated May 25, 2024 • 4 • 1

LoneStriker/aya-23-8B-8.0bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 7

MaziyarPanahi/calme-2.1-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 1.1k • 1

LoneStriker/aya-23-35B-8.0bpw-h8-exl2

Text Generation • Updated May 23, 2024 • 8 • 2

MaziyarPanahi/calme-2.2-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 1.24k • 2

imdeadinside410/Llama-2-Academic-Advising

Updated Jun 1, 2024 • 4

MaziyarPanahi/calme-2.3-phi3-4b-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 349 • 5

BigHuggyD/failspy_Llama-3-70B-Instruct-abliterated-v3-8.0bpw-h8-exl2

Text Generation • Updated May 24, 2024 • 11 • 1

Zoyd/CohereForAI_aya-23-35B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3

Jon-Biz/axolotl

Updated May 24, 2024 • 4

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 4 • 1

Zoyd/CohereForAI_aya-23-8B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3 • 1

Zoyd/RESMPDEV_Qwen1.5-Wukong-1.8B-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 3

gbueno86/Meta-LLama-3-Cat-Smaug-LLama-70b-exl2-8.0bpw

Text Generation • Updated May 24, 2024 • 4

Zoyd/Sao10K_L3-8B-Stheno-v3.1-8_0bpw_exl2

Text Generation • Updated May 24, 2024 • 5 • 3

sahanes/TinyLlamaB_alpaca_2k

Updated May 24, 2024 • 6