Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,550

Full-text search

Active filters: meta

osllmai-community/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Nov 17, 2024 • 2

osllmai-community/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • 73B • Updated Jan 24, 2025 • 2

osllmai-community/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 2

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • 73B • Updated Jan 24, 2025 • 1

osllmai-community/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • 8B • Updated Jan 24, 2025 • 2

mradermacher/Llama3.1-70B-PlumChat-GGUF

71B • Updated Nov 19, 2024 • 83

tensorblock/speechless-llama2-hermes-orca-platypus-wizardlm-13b-GGUF

Text Generation • 13B • Updated Jan 27 • 15

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

71B • Updated Nov 19, 2024 • 239

wonjib/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 18, 2024

wonjib/Llama-3.2-1B-Q5_K_S-GGUF

Text Generation • 1B • Updated Nov 18, 2024

mradermacher/llama-3-8b-256k-PoSE-GGUF

8B • Updated Nov 18, 2024 • 28

mradermacher/llama-3-8b-256k-PoSE-i1-GGUF

8B • Updated Nov 18, 2024 • 56

mlx-community/gradientai_Llama-3-8B-Instruct-Gradient-4194k_4bit

Text Generation • Updated Nov 18, 2024 • 6 • 1

bartowski/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 18, 2024 • 317 • 2

Model-SafeTensors/Llama-2-13b-hf

Text Generation • 13B • Updated Nov 18, 2024 • 6

matrixportalx/Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Nov 19, 2024

matrixportalx/Llama-3.1-8B-Instruct-IQ3_XXS-GGUF

Text Generation • 8B • Updated Nov 25, 2024 • 2

saul95/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Nov 19, 2024 • 11

saul95/Llama-3.2-1B-4.5bpw-exl2

Text Generation • Updated Nov 19, 2024

maum-ai/Llama-3.2-MAAL-11B-Vision-v0.1

11B • Updated Dec 6, 2024 • 15 • 1

sibikarthik/Llama-2-7b-chat-hf-Q4_0-GGUF

Text Generation • 7B • Updated Nov 19, 2024 • 1

tensorblock/urllm-ko-7b-GGUF

Text Generation • 7B • Updated Jan 27 • 11

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 15

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 8

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 2

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 6

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 3

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 1

saul95/Llama-3.2-1B-GPTQ

Text Generation • 1B • Updated Nov 19, 2024 • 62

matrixportalx/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 19, 2024 • 31 • 1