Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,539

Full-text search

Active filters: meta

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 198 • 7

vasileion/Llama-2-13B-chat-GPTQ

Text Generation • 13B • Updated Jul 24, 2024 • 2

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Jul 25, 2024 • 14 • 3

xyottax/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

Efficient-Large-Model/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 8

deven367/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 70

Efficient-Large-Model/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 26, 2024 • 1

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • 410B • Updated Jul 24, 2024 • 3 • 7

SillyTilly/Meta-Llama-3.1-405B-Instruct

Text Generation • 410B • Updated Jul 25, 2024 • 2 • 4

aifeifei798/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 5

mlx-community/Meta-Llama-3.1-405B-4bit

Text Generation • 64B • Updated Jul 31, 2024 • 510 • 5

hoorang/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 1

NicolasNoya/Llama-3-Groq-8B-Tool-Use-Q2_K-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 5

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 2

xsydorm00/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_4.0bpw

Text Generation • Updated Aug 23, 2024

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23, 2024

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Aug 23, 2024 • 1 • 1

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Aug 23, 2024 • 2

qwp4w3hyb/Meta-Llama-3.1-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 168 • 6

qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated Aug 6, 2024 • 338 • 8

stajerc/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 136

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Jul 25, 2024 • 5

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 410B • Updated Jul 25, 2024 • 5

HeRksTAn/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 3

kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024

FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 1

DevBM/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 25, 2024 • 3

pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 3

nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Text Generation • 8B • Updated Jul 26, 2024 • 11