Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14,339

Base only

Active filters: it

MarsupialAI/Lusca-33B

Text Generation • 33B • Updated Oct 22, 2024 • 11 • 10

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated 3 days ago • 71.2k • 30

JanneDoe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 15

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 3

Stark2008/SauerkrautLM-Nemo-12b-Instruct-Q3_K_L-GGUF

12B • Updated Jul 26, 2024 • 12

bartowski/mini-magnum-12b-v1.1-exl2

Text Generation • Updated Jul 27, 2024 • 3 • 1

IntervitensInc/Mistral-Nemo-Base-2407-chatml

Text Generation • 12B • Updated Aug 28, 2024 • 43 • • 7

ek826/Meta-Llama-3.1-405B-Instruct-4.0bpw-exl2

Text Generation • Updated Jul 27, 2024 • 4 • 3

aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored

Text Generation • 8B • Updated Jul 29, 2024 • 838 • • 234

aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored

Text Generation • 8B • Updated Jul 27, 2024 • 103 • • 11

thamada/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 5

Marcus-Arcadius/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 27, 2024 • 8

mozilla-ai/Meta-Llama-3.1-405B-llamafile

Updated Sep 23, 2024 • 5.41k • 4

ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 9, 2024 • 772 • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 7

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 460 • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1.05k • 19

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 536 • 2

bullerwins/Mistral-Large-Instruct-2407-exl2_5.5bpw

Text Generation • Updated Jul 27, 2024 • 3

bartowski/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 924 • 8

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 675 • 21

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Dec 16, 2024 • 784 • 3

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 366 • 1

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • 8B • Updated Aug 11, 2024 • 21 • • 2

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 499 • 3

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 5.31k • 144

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 171 • 5

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-GGUF

8B • Updated Jul 29, 2024 • 99

bullerwins/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 44 • 6

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-GGUF

8B • Updated Jul 28, 2024 • 99