Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,550

Full-text search

Active filters: meta

tensorblock/speechless-llama2-hermes-orca-platypus-13b-GGUF

Text Generation • 13B • Updated Jan 27

WAWQAQ/Llama-2-7b-chat

Text Generation • Updated Nov 20, 2024 • 1

wonjib/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 1

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 3

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 9

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 1

tensorblock/base-eval-GGUF

Text Generation • 8B • Updated Jan 27 • 10

tensorblock/easy-ko-Llama3-8b-Instruct-v1-GGUF

Text Generation • 8B • Updated Jan 27 • 2

jayakody2000lk/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 5

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 8

lfischbe/diss-quik2

Text Generation • 8B • Updated Nov 21, 2024 • 2

tensorblock/Llama-3-instruction-constructionsafety-layertuning-GGUF

8B • Updated Jan 27 • 33

tensorblock/Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 131

tensorblock/Llama-Guard-3-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 13

tensorblock/Llama-3.1-8B-Instruct-GGUF

8B • Updated Jan 27 • 88

tensorblock/Llama-2-13b-chat-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 246

tensorblock/Llama-2-13b-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 44

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 8B • Updated Nov 21, 2024 • 2

ShinnningPikachu/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 1

ShinnningPikachu/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 2

ShinnningPikachu/Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 2

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 8B • Updated Nov 21, 2024 • 3

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B

Text Generation • 8B • Updated Nov 24, 2024 • 75 • 4

unsloth/Llama-3.1-Tulu-3-8B-GGUF

8B • Updated Nov 22, 2024 • 143 • 2

tensorblock/Llama-Guard-3-1B-GGUF

Text Generation • 1B • Updated Jan 27 • 41 • 1

unsloth/Llama-3.1-Tulu-3-70B-GGUF

71B • Updated Nov 22, 2024 • 15 • 1

tensorblock/Llama-2-7b-chat-hf-30-sparsity-GGUF

Text Generation • 7B • Updated Jan 27 • 6

matrixportalx/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • 3B • Updated Nov 22, 2024

matrixportalx/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • 3B • Updated Nov 25, 2024 • 1

tensorblock/Meta-Llama-Guard-2-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 28