Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

AIFunOver/Llama-3.1-70B-Instruct-openvino-4bit

Text Generation • Updated Nov 16, 2024 • 6

prithivMLmods/Llama-Doctor-3.2-3B-Instruct

Text Generation • 3B • Updated Jul 10, 2025 • 52 • 8

tensorblock/Llama3-beomi-Open-Ko-8B-Instruct-preview-test6-GGUF

Text Generation • 8B • Updated Jan 27 • 34

Vincent-Fan/Llama-3.2-1B-Q4_0-GGUF

Text Generation • 1B • Updated Nov 16, 2024 • 10

Vincent-Fan/Llama-2-7b-hf-Q4_K_S-GGUF

Text Generation • 7B • Updated Nov 16, 2024 • 15

Jeffsimpsons/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 16, 2024 • 9

tensorblock/open-llama-2-ko-7b-GGUF

Text Generation • 7B • Updated Jan 27 • 39

VoVoVoViK/C1-2

Text Generation • 8B • Updated Nov 17, 2024 • 9 •

AnasTySia/C-1

Text Generation • 8B • Updated Nov 17, 2024 • 13 •

GasAslan/C1-3

Text Generation • 8B • Updated Nov 17, 2024 • 11 •

osllmai-community/llama-3-8b-Instruct-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 3

osllmai-community/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 5

osllmai-community/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • 73B • Updated Jan 24, 2025 • 3

osllmai-community/llama-3-8b-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 5

mradermacher/Llama-2-7b-chat-hf-function-calling-v3-GGUF

7B • Updated Nov 17, 2024 • 67

osllmai-community/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Jan 24, 2025 • 4

osllmai-community/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Jan 24, 2025 • 3

Danilas/test3

Text Generation • 8B • Updated Nov 17, 2024 • 11 •

ArliAI/Meta-Llama-3.1-70B-Instruct_GPTQ_Q8_min

Text Generation • 71B • Updated Nov 17, 2024 • 3 • 2

sequelbox/Llama3.1-70B-PlumChat

Text Generation • 71B • Updated Dec 4, 2024 • 16 •

mradermacher/Llama-2-7b-chat-hf-function-calling-v3-i1-GGUF

7B • Updated Nov 17, 2024 • 222

osllmai-community/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Nov 17, 2024 • 6

osllmai-community/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • 73B • Updated Jan 24, 2025 • 4

osllmai-community/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 6

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • 73B • Updated Jan 24, 2025 • 3

osllmai-community/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 4

mradermacher/Llama3.1-70B-PlumChat-GGUF

71B • Updated Nov 19, 2024 • 86

tensorblock/speechless-llama2-hermes-orca-platypus-wizardlm-13b-GGUF

Text Generation • 13B • Updated Jan 27 • 49

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

71B • Updated Nov 19, 2024 • 161

wonjib/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 18, 2024 • 3