Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,551

Full-text search

Active filters: meta

shoh99/Llama-2-13b-hf-Q8_0-GGUF

Text Generation • 13B • Updated Oct 16, 2024 • 8

srnm/Meta-Llama-3.1-8B-Instruct-HSE-AI-Hack-tuned-Q8_0-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 25

essobi/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 16, 2024 • 1

quancute/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 17, 2024

apto-as/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Oct 17, 2024 • 20 • 1

apto-as/Llama-3.2-1B-Instruct-Q6_K-GGUF

Text Generation • 1B • Updated Oct 17, 2024 • 4 • 1

Advantech-EIOT/intel_llama-3.1-8b-instruct

Updated Oct 17, 2024 • 4

facebook/layerskip-llama3.2-1B

Text Generation • 1B • Updated Oct 26, 2024 • 2.49k • 24

yokelbear/test

Text Generation • Updated Oct 18, 2024 • 1

mlx-community/Llama-3.2-11B-Vision-Instruct-4bit

Image-Text-to-Text • 2B • Updated Oct 18, 2024 • 583 • 6

shaileshsarda/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 4

mlx-community/Llama-3.2-11B-Vision-Instruct-8bit

Image-Text-to-Text • 3B • Updated Oct 18, 2024 • 1.21k • 10

fizzyfrys/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Oct 18, 2024 • 5

fizzyfrys/Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 2

lilalola/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 18, 2024

lilalola/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 18, 2024 • 1

lilalola/Llama-3.2-1B-Instruct-Q5_K_M-GGUF

Text Generation • 1B • Updated Oct 19, 2024

sking115422/Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Oct 19, 2024 • 3

VincentGOURBIN/Llama-Guard-3-8B

Text Generation • 8B • Updated Oct 19, 2024 • 15

thangtest/Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Oct 19, 2024 • 4 •

tjake/Llama-3.1-8B-Instruct-JQ4

Text Generation • Updated Oct 19, 2024 • 16

tjake/Llama-3.2-1B-Instruct-JQ4

Text Generation • Updated Oct 19, 2024 • 122 • 3

tjake/Llama-3.2-3B-Instruct-JQ4

Text Generation • Updated Oct 19, 2024 • 35

katopz/kbtg-kpoint-v1-fused

Text Generation • 3B • Updated Oct 20, 2024 • 6

Jahid05/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 20, 2024

swpranta/Llama-3.2-1B-Instruct-Q4_0-GGUF

Text Generation • 1B • Updated Oct 20, 2024 • 34

gohsyi/Llama-3.1-8B

Text Generation • 8B • Updated Oct 21, 2024

Tygodv/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 21, 2024

swpranta/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 22, 2024 • 1

dnaney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 22, 2024 • 2