Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,539

Full-text search

Active filters: meta

AI-Engine/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated May 1, 2024 • 163 • 9

LoneStriker/Meta-Llama-3-8B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 34 • 15

mlx-community/Meta-Llama-3-8B-Instruct-8bit

Text Generation • 3B • Updated Apr 19, 2024 • 104 • 5

NousResearch/Meta-Llama-3-70B-GGUF

Text Generation • 71B • Updated Apr 18, 2024 • 162 • 13

QuantFactory/Meta-Llama-Guard-2-8B-GGUF

Text Generation • 8B • Updated Apr 19, 2024 • 168 • 12

LoneStriker/Meta-Llama-3-8B-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 1 • 2

LoneStriker/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Apr 23, 2024 • 29 • 18

mlx-community/Meta-Llama-Guard-2-8B-8bit

Text Generation • Updated Apr 18, 2024 • 10

lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated May 3, 2024 • 7.57k • 187

mlx-community/Meta-Llama-3-8B-8bit

Text Generation • 3B • Updated Apr 18, 2024 • 71 • 5

LoneStriker/Meta-Llama-3-8B-3.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1

LoneStriker/Meta-Llama-3-8B-4.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1 • 1

senseable/Trillama-8B

Text Generation • 8B • Updated Apr 18, 2024 • 9 • 3

LoneStriker/Meta-Llama-3-8B-5.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024

LoneStriker/Meta-Llama-3-8B-6.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1

LoneStriker/Meta-Llama-3-8B-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 1 • 1

LiteLLMs/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 18, 2024 • 376 • 2

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GPTQ

Text Generation • 8B • Updated Apr 19, 2024 • 1.35k • 6

aless2212/Meta-Llama-3-8B-Instruct-onnx-fp16

Text Generation • Updated Apr 18, 2024 • 4

aptha/Meta-Llama-3-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Apr 18, 2024 • 241 • 2

bartowski/Meta-Llama-3-8B-Instruct-GGUF-old

Text Generation • 8B • Updated Apr 22, 2024 • 50 • 15

solidrust/Trillama-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 3 • 1

LoneStriker/Meta-Llama-3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 7

LiteLLMs/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Apr 19, 2024 • 69 • 8

LoneStriker/Meta-Llama-3-70B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1 • 3

LoneStriker/Meta-Llama-3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 9 • 6

LoneStriker/Meta-Llama-3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Apr 23, 2024

LoneStriker/Meta-Llama-3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1 • 2

LoneStriker/Meta-Llama-3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 3

LoneStriker/Meta-Llama-3-70B-Instruct-2.65bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 1