Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,535

Full-text search

Active filters: meta

QuantFactory/Llama-Guard-3-8B-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 226 • 2

yashagra/Llama-2-7b-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 30, 2024 • 9

QuantFactory/Llama-2-13b-chat-hf-GGUF

Text Generation • 13B • Updated Jul 30, 2024 • 6 • 1

Georgia47/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 30, 2024 • 4 • 1

jitsi/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024

Niansuh/Prompt-Guard-86M

Text Classification • Updated Jul 30, 2024 • 96 • 2

vaibhavsatpathy/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 3

vaibhavsatpathy/Meta-Llama-3-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 2

adonald/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 39

vaibhavsatpathy/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 4

lee-ite/Llama-3.1-8B-PHQ

Text Generation • 8B • Updated Jul 30, 2024 • 11

Dabitron/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 1

Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation • 71B • Updated Jul 31, 2024 • 1

kaetemi/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 31, 2024 • 7

zhentaoyu/Llama-3-8B-Instruct-Gradient-1048k-Q4_0-GGUF

Text Generation • 8B • Updated Jul 31, 2024 • 10

tango67/Llama-3-70B-Instruct-exl2-5.0bpw

Text Generation • Updated Jul 31, 2024

Georgia47/Meta-Llama-3-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Jul 31, 2024 • 9

Apel-sin/meta-llama-3.1-70B-instruct-exl2

Text Generation • Updated Jul 31, 2024

fanshanga/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 31, 2024 • 3

hamminson/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • 8B • Updated Aug 1, 2024

e-lumos/Llama-3-KoEn-8B-Instruct-preview-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 2

latentheat/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 4

polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 2

polyverse/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024

polyverse/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024

polyverse/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 12

cha9ro/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Aug 1, 2024

kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 1

facebook/layerskip-codellama-7B

Text Generation • 7B • Updated Oct 19, 2024 • 100 • 6

swilde42/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024