Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,867

Full-text search

Active filters: llama-cpp

PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct-Q4_K_M-GGUF

71B • Updated Jul 17, 2024 • 3

clarkguilty/cosmosage-v3-Q8_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 4

clarkguilty/cosmosage-v3-Q6_K-GGUF

Text Generation • 8B • Updated Jul 15, 2024

VAIBHAV22334455/NOVA-3B.v2-Q8_0-GGUF

3B • Updated Jul 15, 2024

Lancer1408/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF

15B • Updated Jul 15, 2024 • 10

plehrman24/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024

vincentl2189/RolePlayLake-7B-Toxic-Q5_K_M-GGUF

7B • Updated Jul 15, 2024 • 4

plehrman24/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 15, 2024

Ransss/L3-15B-MythicalMaid-t0.0001-Q8_0-GGUF

15B • Updated Jul 15, 2024

Ransss/L3-15B-MythicalMaid-t0.0001-Q6_K-GGUF

15B • Updated Jul 15, 2024 • 2

Ransss/L3-8B-Tamamo-v1-Q8_0-GGUF

8B • Updated Jul 15, 2024 • 1

reach-vb/NuminaMath-7B-TIR-Q8_0-GGUF

Text Generation • 7B • Updated Jul 15, 2024 • 7 • 24

bazsalazas/Mistral-7B-v0.3-Q4_K_M-GGUF

Updated Jul 15, 2024 • 2

Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF

9B • Updated Jul 15, 2024 • 3

Alex01837178373/gemma-2-9b-it-abliterated-IQ3_M-GGUF

9B • Updated Jul 15, 2024 • 21

Alex01837178373/gemma-2-9b-it-abliterated-Q4_K_M-GGUF

9B • Updated Jul 15, 2024 • 15

Aldaris/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

16B • Updated Jul 16, 2024 • 12

Aldaris/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

16B • Updated Jul 16, 2024 • 31

qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • 9B • Updated Jul 16, 2024 • 3

KnutJaegersberg/gemma-2-9b-it-abliterated-Q8_0-GGUF

9B • Updated Jul 16, 2024 • 22 • 1

Bhargav3514/Fox-1-1.6B-Instruct-v0.1-Q4_K_M-GGUF

2B • Updated Jul 16, 2024 • 1

amitj1jan/Meta-Llama-3-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Jul 16, 2024

Cran-May/Chinese-LLaMA-2-13B-hf-Q4_K_M-GGUF

13B • Updated Jul 16, 2024 • 3

martintomov/NuminaMath-7B-TIR-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 16, 2024

martintomov/NuminaMath-7B-TIR-Q8_0-GGUF

Text Generation • 7B • Updated Jul 16, 2024

guihudge2/Mistral-7B-v0.3-Q4_K_M-GGUF

7B • Updated Jul 16, 2024 • 4

martintomov/gpt2_1558M_final4_hf-Q4_K_M-GGUF

2B • Updated Jul 16, 2024 • 2

SansarK/Sam-Q4_K_S-GGUF

0.5B • Updated Jul 16, 2024 • 2

dH29010/falcon-7b-instruct-Q4_K_M-GGUF

7B • Updated Jul 16, 2024 • 7

dons6811/llama-3-8B-Instruct-function-calling-v0.2-Q4_K_M-GGUF

8B • Updated Jul 16, 2024 • 11