Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,551

Full-text search

Active filters: meta

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 708

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 692 • 2

mukel/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Sep 26, 2024 • 85 • 5

jncraton/Llama-3.2-1B-Instruct-ct2-int8

Text Generation • Updated Sep 26, 2024

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 26, 2024 • 100

TheCluster/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 26

mradermacher/Llama-3.2-3B-Instruct-GGUF

3B • Updated Sep 26, 2024 • 1.05k • 2

mradermacher/Llama-3.2-1B-Instruct-GGUF

1B • Updated Sep 25, 2024 • 140

mradermacher/Llama-3.2-3B-i1-GGUF

3B • Updated Sep 26, 2024 • 53

mradermacher/Llama-3.2-1B-Instruct-i1-GGUF

1B • Updated Sep 25, 2024 • 45

SinclairSchneider/Llama-3.2-11B-Vision

Image-Text-to-Text • 11B • Updated Sep 25, 2024 • 4

mlx-community/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Sep 25, 2024 • 798 • 8

mlx-community/Llama-3.2-1B-Instruct-bf16

Text Generation • 1B • Updated Sep 26, 2024 • 348 • 5

mlx-community/Llama-3.2-1B-Instruct-8bit

Text Generation • 0.3B • Updated Sep 26, 2024 • 519 • 1

SinclairSchneider/Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text • 11B • Updated Sep 26, 2024 • 7

mlx-community/Llama-3.2-3B-Instruct-bf16

Text Generation • 3B • Updated Sep 26, 2024 • 106 • 3

jncraton/Llama-3.2-3B-Instruct-ct2-int8

Text Generation • Updated Sep 26, 2024 • 12 • 2

unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 91B • Updated Nov 22, 2024 • 301 • 19

mlx-community/Llama-3.2-3B-Instruct-8bit

Text Generation • 0.9B • Updated Sep 26, 2024 • 47k • 2

SinclairSchneider/Llama-Guard-3-11B-Vision

Image-Text-to-Text • 11B • Updated Sep 26, 2024 • 15 • 2

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 26, 2024 • 50 • 1

tjake/Llama-3.2-1B-Instruct-Jlama-Q4

Text Generation • Updated Oct 16, 2024 • 4 • 1

royleibov/Llama-3.2-11B-Vision-Instruct-ZipNN-Compressed

Image-Text-to-Text • Updated Sep 26, 2024 • 1 • 4

SinclairSchneider/Llama-3.2-90B-Vision

Image-Text-to-Text • 89B • Updated Sep 27, 2024 • 5

mradermacher/Llama-Guard-3-1B-GGUF

1B • Updated Sep 26, 2024 • 100

mradermacher/Llama-Guard-3-1B-i1-GGUF

1B • Updated Sep 26, 2024 • 16

AXCXEPT/EZO-Llama-3.2-3B-Instruct-dpoE

Text Generation • 3B • Updated Sep 26, 2024 • 31 • 10

mradermacher/Llama-3.2-3B-Instruct-i1-GGUF

3B • Updated Sep 26, 2024 • 137 • 2

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 26, 2024 • 132

Solshine/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 26, 2024 • 102 • 1