Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

schaye/llama-3.2-3b-instruct-mlx-finetuned-bedtimestory1

Text Generation • 0.5B • Updated Oct 13, 2024 • 7

afifit/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 13, 2024 • 12

luminoussg/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 14, 2024 • 16

TinyLamda/llama-3.2-1b-4bit-128g

Text Generation • Updated Oct 14, 2024 • 3

TinyLamda/llama-3.2-3b-4bit-128g

Text Generation • Updated Oct 14, 2024 • 5

Abc7347/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 14, 2024 • 4

sheldonrobinson/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Oct 14, 2024 • 3

sheldonrobinson/Llama-Guard-3-1B-Q4_0-GGUF

Text Generation • 1B • Updated Oct 14, 2024 • 6

bbennett17/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Mar 16, 2025 • 8

heisenburgerking/heisenbergllama3.1

Text Generation • 8B • Updated Oct 17, 2024 • 7

pcuenq/Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 15, 2024 • 6

pcuenq/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 16, 2024 • 8

whp22/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 16, 2024 • 8

quancute/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 16, 2024 • 2

AlekseyElygin/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 11B • Updated Oct 16, 2024 • 1

shoh99/Llama-2-13b-hf-Q8_0-GGUF

Text Generation • 13B • Updated Oct 16, 2024 • 19

srnm/Meta-Llama-3.1-8B-Instruct-HSE-AI-Hack-tuned-Q8_0-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 39

essobi/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 16, 2024 • 7

quancute/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 17, 2024 • 8

apto-as/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Oct 17, 2024 • 36 • 1

apto-as/Llama-3.2-1B-Instruct-Q6_K-GGUF

Text Generation • 1B • Updated Oct 17, 2024 • 17 • 1

Advantech-EIOT/intel_llama-3.1-8b-instruct

Updated Oct 17, 2024 • 4

facebook/layerskip-llama3.2-1B

Text Generation • 1B • Updated Oct 26, 2024 • 1.05k • 28

yokelbear/test

Text Generation • Updated Oct 18, 2024 • 2

mlx-community/Llama-3.2-11B-Vision-Instruct-4bit

Image-Text-to-Text • 2B • Updated Oct 18, 2024 • 1.02k • 7

shaileshsarda/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 8

mlx-community/Llama-3.2-11B-Vision-Instruct-8bit

Image-Text-to-Text • 3B • Updated Oct 18, 2024 • 1.35k • 9

fizzyfrys/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Oct 18, 2024 • 19

fizzyfrys/Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 18, 2024 • 6

lilalola/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 18, 2024 • 6