Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,844

Full-text search

Active filters: llama-cpp

openerotica/Llama-3-lima-nsfw-16k-test-GGUF

8B • Updated May 17, 2024 • 215 • 8

linh5nb/Llama-2-7b-chat-startup-9-Q4_K_M-GGUF

7B • Updated May 16, 2024 • 5

ClaudioItaly/mergekit-slerp-ebgdloh-Q5_K_M-GGUF

7B • Updated May 16, 2024

cobrakenji/granite-20b-code-base-Q3_K_M-GGUF

Text Generation • 20B • Updated May 16, 2024

cobrakenji/granite-34b-code-base-Q2_K-GGUF

Text Generation • 34B • Updated May 16, 2024 • 3

noxinc/Mistral-portuguese-luana-7b-chat-Q8_0-GGUF-PTBR

Text Generation • 7B • Updated May 16, 2024 • 33

noxinc/Mistral-portuguese-luana-7b-Q8_0-GGUF-PTBR

Text Generation • 7B • Updated May 16, 2024 • 5

noxinc/Mistral-portuguese-luana-7b-mental-health-Q8_0-GGUF-PTBR

Text Generation • 7B • Updated May 16, 2024 • 2

Ransss/LLama-3-8b-Lexi-Iranian-Stories-PersianTherapist-Lumimaid-DARE_TIES-Q8_0-GGUF

8B • Updated May 16, 2024 • 21

celek/granite-3b-code-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated May 16, 2024 • 14

ClaudioItaly/mergekit-slerp-ebgdloh-Q8_0-GGUF

7B • Updated May 16, 2024

ClaudioItaly/Topsecret-Q5_0-GGUF

5B • Updated May 16, 2024

wwe180/Hermes-2-Pro-Llama-3-13B-Q4_K_M-GGUF

12B • Updated May 16, 2024 • 49

suyupte/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated May 16, 2024

wwe180/Hermes-2-Pro-Llama-3-13B-Q6_K-GGUF

12B • Updated May 16, 2024 • 1

e2jhiubyiiyvw/Pantheon-RP-1.0-8b-Llama-3-Q5_K_M-GGUF

8B • Updated May 16, 2024 • 1

joshnader/rho-math-7b-interpreter-v0.1-Q4_K_M-GGUF

Text Generation • 7B • Updated May 17, 2024 • 3

joshnader/deepseek-math-7b-instruct-Q4_K_M-GGUF

7B • Updated May 16, 2024 • 425

wwe180/Llama3-12B-Chinese-lingyang-Q6_K-GGUF

12B • Updated May 17, 2024 • 3

ArturoVitale/Minerva-1B-base-v1.0-Q4_K_M-GGUF

Text Generation • 1B • Updated May 17, 2024 • 6

franciscobdl/EstigiaxTinyLlama1.1-Q4_K_M-GGUF

1B • Updated May 17, 2024 • 7

franciscobdl/EstigiaxTinyLlama-Q4_K_M-GGUF

1B • Updated May 17, 2024 • 3

skyxiaobaibai/gemma-2b-Q4_K_M-GGUF

3B • Updated May 17, 2024 • 6

lock-rr/Bahasa-4b-chat-Q4_K_M-GGUF

4B • Updated May 17, 2024 • 2

lock-rr/cendol-llama2-13b-merged-chat-Q4_K_M-GGUF

13B • Updated May 17, 2024 • 3

XCraftMC/Rhea-72b-v0.5-Q4_K_M-GGUF

Updated May 17, 2024 • 2

Tales-Alves/Meta-Llama-3-8B-Q6_K-GGUF

Text Generation • 8B • Updated May 17, 2024

berquetR/phi15_second_run_non_quantized-Q4_K_M-GGUF

4B • Updated May 17, 2024 • 2

DarwinAnim8or/gpt2-grugged-6-Q4_K_M-GGUF

Text Generation • 2B • Updated May 17, 2024 • 20

henriksound/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • 7B • Updated May 17, 2024