Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14,265

Base only

Active filters: it

QuantFactory/ghost-8b-beta-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 129 • 1

Kaan35/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B • Updated Jul 29, 2024 • 50

GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 20

Kaan35/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Jul 26, 2024 • 18 • 1

WongBingbing/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 26, 2024 • 10

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 3

MarsupialAI/Lusca-33B

Text Generation • 33B • Updated Oct 22, 2024 • 11 • 10

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated 2 days ago • 72.8k • 30

JanneDoe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 15

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 3

Stark2008/SauerkrautLM-Nemo-12b-Instruct-Q3_K_L-GGUF

12B • Updated Jul 26, 2024 • 12

bartowski/mini-magnum-12b-v1.1-exl2

Text Generation • Updated Jul 27, 2024 • 3 • 1

IntervitensInc/Mistral-Nemo-Base-2407-chatml

Text Generation • 12B • Updated Aug 28, 2024 • 42 • • 7

ek826/Meta-Llama-3.1-405B-Instruct-4.0bpw-exl2

Text Generation • Updated Jul 27, 2024 • 4 • 3

aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored

Text Generation • 8B • Updated Jul 29, 2024 • 841 • • 234

aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored

Text Generation • 8B • Updated Jul 27, 2024 • 101 • • 11

thamada/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 3

Marcus-Arcadius/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 27, 2024 • 8

mozilla-ai/Meta-Llama-3.1-405B-llamafile

Updated Sep 23, 2024 • 4.71k • 4

ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 9, 2024 • 760 • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 7

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 429 • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1k • 19

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 508 • 2

bullerwins/Mistral-Large-Instruct-2407-exl2_5.5bpw

Text Generation • Updated Jul 27, 2024 • 3

bartowski/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 921 • 8

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 654 • 21

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Dec 16, 2024 • 772 • 3

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 341 • 1

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • 8B • Updated Aug 11, 2024 • 21 • • 2