Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

Esperanto/llama-3.2-1B-Instruct-kvc-fp16-onnx

Text Generation • Updated Dec 11, 2024 • 6

Esperanto/llama-3.2-3B-Instruct-kvc-fp16-onnx

Text Generation • Updated Dec 11, 2024 • 5 • 1

Esperanto/llama-3.2-1B-kvc-fp16-onnx

Text Generation • Updated Dec 11, 2024 • 6

cyrille-colin/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 9, 2024 • 13

schaye/llama-3.2-1b-instruct-mlx-finetuned-bedtimestory

Text Generation • 0.2B • Updated Oct 9, 2024 • 8

hongphucpham/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 9, 2024 • 6

altomek/Llama-3.1-70B-Instruct-5bpw-EXL2

Text Generation • Updated Oct 10, 2024 • 6

Sudipta1995/metallama3.1

Text Generation • 8B • Updated Oct 9, 2024 • 7

sheldonrobinson/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 10, 2024 • 7 • 1

sheldonrobinson/Llama-Guard-3-1B-Q8_0-GGUF

Text Generation • 1B • Updated Oct 10, 2024 • 4

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10, 2024 • 7

chiizaraa/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 10, 2024 • 10

reach-vb/l3.2-1b-test

Text Generation • 1B • Updated Oct 11, 2024 • 3

josiahdavis/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 11, 2024 • 3

SalmanFaroz/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B • Updated Oct 11, 2024 • 24

SalmanFaroz/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 11, 2024 • 7

SalmanFaroz/Llama-3.2-1B-Instruct-Q3_K_M-GGUF

Text Generation • 1B • Updated Oct 11, 2024 • 12

schaye/llama-3.2-1b-instruct-mlx-finetuned-bedtimestory3

Text Generation • 0.2B • Updated Oct 11, 2024 • 7

schaye/llama-3.2-1b-instruct-mlx-finetuned-bedtimestory2

Text Generation • 0.2B • Updated Oct 11, 2024 • 8

sheldonrobinson/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 11, 2024 • 4

littlekeivon/Llama-3.2-1B-Q5_K_M-GGUF

Text Generation • 1B • Updated Oct 12, 2024 • 7 • 1

schaye/llama-3.2-1b-instruct-mlx-finetuned-bedtimestory4

Text Generation • 0.2B • Updated Oct 12, 2024 • 8

schaye/llama-3.2-1b-instruct-mlx-finetuned-bedtimestory5

Text Generation • 0.2B • Updated Oct 12, 2024 • 5

John6666/Llama-3.1-8B-Lexi-Uncensored-V2-nf4

Text Generation • 8B • Updated Oct 13, 2024 • 256 • 24

Ya211/llamaEXL

Text Generation • Updated Oct 13, 2024 • 9

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13, 2024 • 13

avans06/Meta-Llama-3.2-8B-Instruct

Text Generation • 8B • Updated Oct 13, 2024 • 53 • • 1

AndoShy/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 13, 2024 • 6

AndoShy/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 13, 2024 • 3

thos0412/llama-2-ko-7b-Q4_K_M-GGUF

Text Generation • 7B • Updated Oct 13, 2024 • 5