Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,536

Full-text search

Active filters: meta

rcebot/Llama-3-8B

Text Generation • 8B • Updated Aug 13, 2024

lucasdozie/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 12, 2024 • 1

pgurazada1/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Aug 12, 2024 • 5 • 1

UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B

Text Generation • 8B • Updated Aug 30, 2024 • 31 • 1

fakezeta/Meta-Llama-3.1-8B-Instruct-ov-awq

Text Generation • Updated Aug 12, 2024 • 2

pgurazada1/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 4

DaveLeongSG/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 7

Mylaux/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 1

Karthikeyan-M3011/llama2-fin-summarizer

Text Generation • Updated Aug 14, 2024

Alex156/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 1

Alex156/Meta-Llama-3-8B-Q2_K-GGUF

Text Generation • 8B • Updated Aug 13, 2024

reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix

Text Generation • 8B • Updated Aug 14, 2024 • 4

fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

Text Generation • 71B • Updated Aug 21, 2024 • 4

fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

Text Generation • 73B • Updated Oct 5, 2024 • 10

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Aug 14, 2024 • 1 • 1

ipetrukha/CodeLlama-7b-Instruct-hf-4bit

Text Generation • 1B • Updated Aug 15, 2024 • 9

aistuffllm/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Aug 14, 2024 • 4

codys12/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • 423B • Updated Aug 14, 2024 • 2

ipetrukha/CodeLlama-13b-Instruct-hf-4bit

Text Generation • 1B • Updated Aug 15, 2024 • 16

ipetrukha/CodeLlama-34b-Instruct-hf-4bit

Text Generation • 1B • Updated Aug 15, 2024 • 20

lmutimb/Meta-Llama-3.1-8B-Q5_0-GGUF

Text Generation • 8B • Updated Aug 15, 2024 • 2

rktmeister/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 17, 2024 • 40

manbeast3b/Meta-Llama-3.1-8B-Instruct-bnb-4bit9

Text Generation • 5B • Updated Aug 17, 2024 • 4

aftersoft/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 17, 2024

ek826/Meta-Llama-3.1-405B-Instruct-4.25bpw-gqa-exl2

Text Generation • Updated Aug 17, 2024 • 1 • 1

irresistiblegrace97/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 18, 2024

irresistiblegrace97/Llama-2-7b-chat-hf-Q2_K-GGUF

Text Generation • 7B • Updated Aug 18, 2024

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 18, 2024 • 7 • 1

irresistiblegrace97/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Aug 19, 2024 • 5

lanok/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 3