Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,852

Full-text search

Active filters: llama-cpp

newsletter/wavecoder-ultra-6.7b-Q6_K-GGUF

Text Generation • 7B • Updated May 30, 2024 • 7

arnavchopraa/Mistral-7B-v0.1-Q4_K_M-GGUF

Text Generation • 7B • Updated Jun 3, 2024 • 8

YorkieOH10/internlm2-math-plus-7b-Q8_0-GGUF

Text Generation • 8B • Updated May 27, 2024

ybelkada/test-gguf-trainer-Q4_K_M-GGUF

1.03M • Updated May 27, 2024 • 9

NikolayKozloff/Llama-3-Instruct-8B-SimPO-Q4_0-GGUF

8B • Updated May 27, 2024 • 5 • 1

NikolayKozloff/internlm2-math-plus-7b-Q6_K-GGUF

Text Generation • 8B • Updated May 27, 2024 • 1 • 1

NikolayKozloff/internlm2-math-plus-7b-Q4_K_M-GGUF

Text Generation • 8B • Updated May 27, 2024 • 3 • 1

NikolayKozloff/internlm2-math-plus-7b-Q5_K_M-GGUF

Text Generation • 8B • Updated May 27, 2024 • 2 • 1

NikolayKozloff/internlm2-math-plus-1_8b-Q8_0-GGUF

Text Generation • 2B • Updated May 27, 2024 • 1 • 1

skyxiaobaibai/gemma-1.1-2b-it-Q4_0-GGUF

3B • Updated May 27, 2024 • 4 • 1

NikolayKozloff/internlm2-math-plus-20b-Q3_K_S-GGUF

Text Generation • 20B • Updated May 27, 2024 • 1 • 1

NikolayKozloff/internlm2-math-plus-20b-Q3_K_M-GGUF

Text Generation • 20B • Updated May 27, 2024 • 1

NikolayKozloff/internlm2-math-plus-20b-Q3_K_L-GGUF

Text Generation • 20B • Updated May 27, 2024 • 1 • 1

NikolayKozloff/internlm2-math-plus-20b-Q4_K_S-GGUF

Text Generation • 20B • Updated May 27, 2024 • 1 • 1

NikolayKozloff/internlm2-math-plus-20b-Q4_0-GGUF

Text Generation • 20B • Updated May 27, 2024 • 1 • 1

goberten/L3-70B-daybreak-storywriter-v0.4-Q5_K_M-GGUF

71B • Updated May 27, 2024

NikolayKozloff/Llama-3-Instruct-8B-SimPO-Q5_0-GGUF

8B • Updated May 27, 2024 • 1

ljredux/dolphin-2.9.1-llama-3-8b-Q8_0-GGUF

8B • Updated May 27, 2024 • 21

KingsonHO/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated May 27, 2024

MoMonir/AutoCoder_S_6.7B-GGUF

7B • Updated May 27, 2024 • 15

ultamaster/saiga_llama3_8b-Q4_K_M-GGUF

8B • Updated May 27, 2024 • 47

ultamaster/saiga_llama3_8b-Q8_0-GGUF

8B • Updated May 27, 2024 • 2

KatyTheCutie/Llama-3-13B-Instruct-ft-Q5_K_M-GGUF

13B • Updated May 27, 2024 • 69

PsyDuuk/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated May 27, 2024

franciscobdl/EstigiaxTinyLlama1.2-Q4_K_M-GGUF

1B • Updated May 27, 2024 • 4

aaronday3/WizardLM-2-7B-abliterated-Q3_K_M-GGUF

7B • Updated May 27, 2024 • 11

andreass123/Llama-3-Open-Ko-8B-Instruct-teddynote-Q4_K_S-GGUF

8B • Updated May 27, 2024 • 3

NovNovikov/c4ai-command-r-v01-Q4_K_S-GGUF

35B • Updated May 28, 2024

andreass123/Llama-3-Open-Ko-8B-Instruct-teddynote-Q3_K_S-GGUF

8B • Updated May 28, 2024

NovNovikov/c4ai-command-r-v01-Q3_K_L-GGUF

35B • Updated May 28, 2024 • 3