Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,822

Base only

Active filters: th

SeaLLMs/SeaLLMs-v3-7B

Text Generation • 8B • Updated Jul 30, 2024 • 270 • • 7

nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Text Generation • 8B • Updated Jul 26, 2024 • 41

Morgen0052/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 7

v3ray/Llama-3-1-70B-Instruct-base

Text Generation • 71B • Updated Jul 26, 2024 • 12 •

Kondara/SeaLLMs-v3-7B-Chat-Q4_K_M-GGUF

8B • Updated Jul 26, 2024 • 4

trokhymovych/TRank_readability

Text Classification • Updated Jul 26, 2024 • 4

GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 15

WongBingbing/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 9

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated 20 days ago • 81.1k • 30

JanneDoe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 18

ek826/Meta-Llama-3.1-405B-Instruct-4.0bpw-exl2

Text Generation • Updated Jul 27, 2024 • 4 • 3

aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored

Text Generation • 8B • Updated Jul 29, 2024 • 1.07k • • 235

aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored

Text Generation • 8B • Updated Jul 27, 2024 • 144 • • 11

thamada/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 6

mozilla-ai/Meta-Llama-3.1-405B-llamafile

Updated Sep 23, 2024 • 11.2k • 4

ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 9, 2024 • 262 • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 5

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 454 • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1.4k • 19

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 716 • 2

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 835 • 21

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Dec 16, 2024 • 606 • 3

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 742 • 1

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 775 • 3

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 4.72k • 144

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 496 • 5

bullerwins/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 82 • 6

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • 117B • Updated Sep 16, 2024 • 139 • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • 3B • Updated Jul 28, 2024 • 24

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • 21B • Updated Aug 8, 2024 • 5 • 2