Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,743

Base only

Active filters: meta

mradermacher/GOAT-70B-Storytelling-i1-GGUF

69B • Updated Dec 5, 2024 • 120 • 2

shashikanth-a/Llama-3.2-11B-Vision-4bit

Image-Text-to-Text • 1B • Updated Dec 4, 2024 • 78 • 2

AIFunOver/Llama-Guard-3-1B-openvino-fp16

Text Generation • Updated Dec 5, 2024 • 6

AIFunOver/Llama-Guard-3-1B-openvino-8bit

Text Generation • Updated Dec 5, 2024 • 6

AIFunOver/Llama-Guard-3-1B-openvino-4bit

Text Generation • Updated Dec 5, 2024 • 5

tarabukinivan/llama3.2

Text Generation • 1B • Updated Oct 24, 2024 • 7 • • 1

pkononenko/Llama-3.1-8B-Instruct-fixed-config

Text Generation • 8B • Updated Dec 5, 2024 • 6

Suraj710/Llama-3.2-1B-trial

Text Generation • Updated Dec 5, 2024 • 4

fbaldassarri/meta-llama_Llama-3.1-8B-auto_round-int4-gs128-asym

Text Generation • 2B • Updated Dec 5, 2024 • 5

fbaldassarri/meta-llama_Llama-3.1-8B-auto_round-int4-gs128-sym

Text Generation • 2B • Updated Dec 5, 2024 • 9

tensorblock/Meta-Llama-3-8B-Instruct-hf-GGUF

Text Generation • 8B • Updated Jan 27 • 8

facebook/metamotivo-S-1

24.5M • Updated Dec 12, 2024 • 1.46k • 11

facebook/metamotivo-S-2

24.5M • Updated Dec 12, 2024 • 5 • 2

facebook/metamotivo-S-3

24.5M • Updated Dec 12, 2024 • 5 • 2

facebook/metamotivo-S-4

24.5M • Updated Dec 12, 2024 • 7 • 2

facebook/metamotivo-S-5

24.5M • Updated Dec 12, 2024 • 2 • 1

facebook/metamotivo-M-1

0.3B • Updated Dec 12, 2024 • 387 • 8

gtg489p/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Dec 6, 2024 • 2

tensorblock/Llama-3-70B-Instruct-Gradient-1048k-GGUF

Text Generation • 71B • Updated Jan 27 • 60 • 1

tensorblock/Llama-3-instruction-constructionsafety-GGUF

8B • Updated Jan 27 • 89

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • 9B • Updated Dec 6, 2024 • 530 • 8

mlx-community/Llama-3.3-70B-Instruct-4bit

Text Generation • 11B • Updated Dec 6, 2024 • 10.8k • 35

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • 15B • Updated Dec 6, 2024 • 392 • 5

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • 20B • Updated Dec 6, 2024 • 4.46k • 14

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 21.8k • 75

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 6, 2024 • 20.4k • 55

mlx-community/Llama-3.3-70B-Instruct-bf16

Text Generation • 71B • Updated Dec 6, 2024 • 159 • 1

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 16.1k • 12

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • 71B • Updated Nov 25, 2025 • 9.02k • 52

unsloth/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 10, 2025 • 23.6k • 123