Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,743

Base only

Active filters: meta

mradermacher/llama-3-8b-256k-PoSE-GGUF

8B • Updated Nov 18, 2024 • 74

mradermacher/llama-3-8b-256k-PoSE-i1-GGUF

8B • Updated Nov 18, 2024 • 124

mlx-community/gradientai_Llama-3-8B-Instruct-Gradient-4194k_4bit

Text Generation • 1B • Updated Nov 18, 2024 • 10 • 1

bartowski/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 18, 2024 • 1.05k • 2

Model-SafeTensors/Llama-2-13b-hf

Text Generation • 13B • Updated Nov 18, 2024 • 4

matrixportalx/Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Nov 19, 2024 • 10

matrixportalx/Llama-3.1-8B-Instruct-IQ3_XXS-GGUF

Text Generation • 8B • Updated Nov 25, 2024 • 6

saul95/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Nov 19, 2024 • 28

saul95/Llama-3.2-1B-4.5bpw-exl2

Text Generation • Updated Nov 19, 2024

maum-ai/Llama-3.2-MAAL-11B-Vision-v0.1

11B • Updated Dec 6, 2024 • 7 • 1

sibikarthik/Llama-2-7b-chat-hf-Q4_0-GGUF

Text Generation • 7B • Updated Nov 19, 2024 • 15

tensorblock/urllm-ko-7b-GGUF

Text Generation • 7B • Updated Jan 27 • 12

saul95/Llama-3.2-1B-GPTQ

Text Generation • 1B • Updated Nov 19, 2024 • 168

matrixportalx/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 19, 2024 • 326 • 4

tensorblock/speechless-llama2-hermes-orca-platypus-13b-GGUF

Text Generation • 13B • Updated Jan 27 • 47

WAWQAQ/Llama-2-7b-chat

Text Generation • Updated Nov 20, 2024 • 3

wonjib/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 3

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 4

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 3

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 3

tensorblock/base-eval-GGUF

Text Generation • 8B • Updated Jan 27 • 21

tensorblock/easy-ko-Llama3-8b-Instruct-v1-GGUF

Text Generation • 8B • Updated Jan 27 • 21

jayakody2000lk/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 10

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 5

lfischbe/diss-quik2

Text Generation • 8B • Updated Nov 21, 2024 • 6

tensorblock/Llama-3-instruction-constructionsafety-layertuning-GGUF

8B • Updated Jan 27 • 68

tensorblock/Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 227

tensorblock/Llama-Guard-3-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 83

tensorblock/Llama-3.1-8B-Instruct-GGUF

8B • Updated Jan 27 • 235

tensorblock/Llama-2-13b-chat-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 30