Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,058

Base only

Active filters: pt

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 5

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 436 • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1.57k • 19

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 828 • 2

bullerwins/Mistral-Large-Instruct-2407-exl2_5.5bpw

Text Generation • Updated Jul 27, 2024 • 3

bartowski/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 1.24k • 8

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 909 • 21

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Dec 16, 2024 • 651 • 3

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 869 • 1

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 980 • 3

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 4.7k • 145

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 644 • 5

bullerwins/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 98 • 6

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • 117B • Updated Sep 16, 2024 • 136 • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • 3B • Updated Jul 28, 2024 • 25

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • 21B • Updated Aug 8, 2024 • 6 • 2

mradermacher/Meta-Llama-3.1-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 1.09k

leafspark/Mistral-Large-218B-Instruct

Text Generation • 218B • Updated Aug 5, 2024 • 99 • 2

mradermacher/Meta-Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 16, 2024 • 477 • 3

1-800-SHARED-TASKS/MGTD-Checkpoints

Updated Oct 7, 2024 • 4

mradermacher/mini-magnum-12b-v1.1-i1-GGUF

12B • Updated Aug 2, 2024 • 306 • 3

e2jhiubyiiyvw/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 10

mradermacher/Meta-Llama-3.1-70B-Instruct-i1-GGUF

71B • Updated Dec 16, 2024 • 488 • 2

vicky4s4s/llama-3.1-8B-instruct

Text Generation • 8B • Updated Jul 31, 2024 • 7

mradermacher/Meta-Llama-3.1-70B-GGUF

71B • Updated Dec 16, 2024 • 205

chrypnotoad/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 9

apoorvparmar007/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 8

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

71B • Updated Dec 16, 2024 • 702 • 2

mradermacher/Meta-Llama-3.1-405B-Instruct-GGUF

Updated Dec 16, 2024 • 6

reach-vb/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 135 • 8