Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

iut62elec/llama3_2_1B_FT

Text Generation • 1B • Updated Oct 2, 2024 • 11

bigstorm/Llama-3.2-1B-8.0bpw-8hb-exl2

Text Generation • Updated Oct 2, 2024 • 5

hugger128/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 2, 2024 • 22

amd/Llama-2-7b-hf-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Text Generation • Updated Jun 28, 2025 • 88

amd/Llama2-7b-chat-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Text Generation • Updated Jun 28, 2025 • 6

amd/Llama-3-8B-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Text Generation • Updated Jun 28, 2025 • 10 • 2

amd/Llama-3.1-8B-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Text Generation • Updated Jun 28, 2025 • 18 • 2

v8karlo/Llama-3.2-1B-Instruct-Q8_0-GGUF

1B • Updated Oct 2, 2024 • 37

jacobcarajo/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Oct 2, 2024 • 7

avikam/Llama-2-7b-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Oct 3, 2024 • 4

mradermacher/Llama-3.1-70B-Instruct-abliterated-GGUF

71B • Updated Aug 1, 2025 • 780 • 6

hope-hui/Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 3, 2024 • 27

hope-hui/Llama-3.1-70B-Instruct-Q4_K_M-GGUF

Text Generation • 71B • Updated Oct 3, 2024 • 170

iut62elec/llama3_2_1B_FT_new

Text Generation • 1B • Updated Oct 3, 2024 • 11

carboncrystalx/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 4, 2024 • 17

carboncrystalx/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 4, 2024 • 13

1a3orn/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 4, 2024 • 19

beethogedeon/Llama-3.2-1B-Instruct-Q4_K_S-GGUF

Text Generation • 1B • Updated Oct 4, 2024 • 23

1a3orn/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 4, 2024 • 25

ABDALLALSWAITI/llm_3_2_flux_prompt

Text Generation • 3B • Updated Oct 5, 2024 • 1.84k • • 15

mlx-community/Meta-Llama-3.1-70B-Instruct-bf16-CORRECTED

Text Generation • 71B • Updated Oct 5, 2024 • 144

mradermacher/EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

3B • Updated Aug 1, 2025 • 246 • 1

mradermacher/EZO-Llama-3.2-3B-Instruct-dpoE-i1-GGUF

3B • Updated Oct 11, 2024 • 199 • 1

alan314159/Llama-3.2-1B-Q8_0-GGUF

Text Generation • 1B • Updated Oct 5, 2024 • 17

Danielouo/Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Oct 5, 2024 • 8

argearriojas/Llama-3.2-1B-Instruct-Q5_K_M-GGUF

Text Generation • 1B • Updated Oct 5, 2024 • 11

argearriojas/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Oct 5, 2024 • 11

mylesgoose/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Oct 5, 2024 • 9 •

jairo/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 5, 2024 • 18

jairo/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 5, 2024 • 18