Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,743

Base only

Active filters: meta

tensorblock/Llama-2-13b-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 44

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 8B • Updated Nov 21, 2024 • 6

ShinnningPikachu/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 2

ShinnningPikachu/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 2

ShinnningPikachu/Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 3

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 8B • Updated Nov 21, 2024 • 8

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B

Text Generation • 8B • Updated Nov 24, 2024 • 695 • • 4

unsloth/Llama-3.1-Tulu-3-8B-GGUF

8B • Updated Nov 22, 2024 • 130 • 2

tensorblock/Llama-Guard-3-1B-GGUF

Text Generation • 1B • Updated Jan 27 • 45 • 1

unsloth/Llama-3.1-Tulu-3-70B-GGUF

71B • Updated Nov 22, 2024 • 82 • 1

tensorblock/Llama-2-7b-chat-hf-30-sparsity-GGUF

Text Generation • 7B • Updated Jan 27 • 22

matrixportalx/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • 3B • Updated Nov 22, 2024 • 4

matrixportalx/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • 3B • Updated Nov 25, 2024 • 2

tensorblock/Meta-Llama-Guard-2-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 14

matrixportalx/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • 3B • Updated Nov 22, 2024 • 5

matrixportalx/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Nov 22, 2024 • 36 • 7

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • 8B • Updated 18 days ago • 289 • 5

raethehacker/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Nov 23, 2024 • 5 • 1

alices2/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 23, 2024 • 25 • 1

executorch-community/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8-ET

Text Generation • Updated Apr 10, 2025 • 198 • 1

executorch-community/Llama-3.2-1B-Instruct-QLORA_INT4_EO8-ET

Text Generation • Updated Apr 10, 2025 • 29 • 3

matrixportalx/Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Nov 23, 2024 • 5

mlx-community/Meta-Llama-3.1-8B-Instruct-3bit

Text Generation • 1B • Updated Nov 23, 2024 • 20

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond

Text Generation • 1B • Updated 13 days ago • 44 • 1

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond-gguf

1B • Updated 13 days ago • 166 • 1

matrixportalx/Llama-3.1-8B-Instruct-IQ3_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 11

ckoozzzu/dl6

Text Generation • 8B • Updated Nov 24, 2024 • 13 •

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond

Text Generation • 1B • Updated 13 days ago • 45 • 1

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond-gguf

1B • Updated 13 days ago • 183 • 1

Maites/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 25, 2024 • 13