Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,699

Base only

Active filters: th

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • 15B • Updated Dec 6, 2024 • 337 • 5

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • 20B • Updated Dec 6, 2024 • 5.69k • 15

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 15.3k • 74

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 6, 2024 • 20.8k • 55

mlx-community/Llama-3.3-70B-Instruct-bf16

Text Generation • 71B • Updated Dec 6, 2024 • 193 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 71B • Updated Dec 6, 2024 • 191k • 46

mradermacher/SambaLingo-Thai-Chat-70B-i1-GGUF

69B • Updated Dec 7, 2024 • 119

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 33.9k • 12

matatonic/Llama-3.3-70B-Instruct-6.5bpw-h8-exl2.2.3

Text Generation • Updated Dec 6, 2024 • 1

osllmai-community/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Jan 24, 2025 • 14 • • 2

LoneStriker/Llama-3.3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 4 • 1

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 4 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 12 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-auto_gptq-int4-gs128-asym

Text Generation • 8B • Updated Dec 6, 2024 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-auto_gptq-int4-gs128-sym

Text Generation • 8B • Updated Dec 6, 2024 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 5 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 7 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 2 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2024 • 7 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 6 • 1

mradermacher/Llama-3.3-70B-Instruct-GGUF

71B • Updated Aug 1, 2025 • 157 • 4

second-state/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 28, 2025 • 382

gaianet/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 28, 2025 • 131

mradermacher/Llama-3.3-70B-Instruct-i1-GGUF

71B • Updated Dec 8, 2024 • 251 • 4

tensorblock/Llama-3.3-70B-Instruct-GGUF

71B • Updated Jan 27 • 66 • 9

tensorblock/llama-3.1-Asian-Bllossom-8B-Translator-GGUF

8B • Updated Jan 27 • 4

osllmai-community/Llama-3.3-70B-Instruct-GGUF

71B • Updated Jan 24, 2025 • 14

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Dec 7, 2024 • 83.8k • 30

Dracones/Llama-3.3-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 7, 2024 • 3

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 3