Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,101

Base only

Active filters: llama-cpp

Theta-Lev/internlm2-math-plus-7b-Q8_0-GGUF

Text Generation • 8B • Updated Jul 19, 2024 • 1

aaronday3/L3-8B-Celeste-V1.2-Q4_K_M-GGUF

8B • Updated Jul 19, 2024

aaronday3/L3-8B-Celeste-V1.2-Q6_K-GGUF

8B • Updated Jul 19, 2024 • 1

mjschock/TinySolar-248m-4k-code-instruct-Q4_K_M-GGUF

0.2B • Updated Jul 19, 2024 • 1 • 2

Theta-Lev/rho-math-7b-interpreter-v0.1-Q8_0-GGUF

Text Generation • 7B • Updated Jul 19, 2024 • 11

Theta-Lev/rho-math-1b-interpreter-v0.1-Q8_0-GGUF

Text Generation • 1B • Updated Jul 19, 2024 • 1

mjschock/TinySolar-248m-4k-Q4_K_M-GGUF

0.2B • Updated Jul 19, 2024 • 1

mjschock/TinySolar-248m-4k-py-Q4_K_M-GGUF

0.2B • Updated Jul 19, 2024 • 1

NikolayKozloff/L3-8B-Celeste-V1.2-Q8_0-GGUF

8B • Updated Jul 19, 2024 • 2

Guilherme34/Samantha-qwen-0.5b-ptbr-Q8_0-GGUF

0.5B • Updated Jul 19, 2024 • 2

Guilherme34/Samantha-MoE-Q4_K_M-GGUF

13B • Updated Jul 19, 2024 • 9 • 1

Guilherme34/Samantha-MoE-Q2_K-GGUF

13B • Updated Jul 19, 2024 • 6

AlexLee00/solar_v01-Q4_K_M-GGUF

11B • Updated Jul 20, 2024 • 4

netcat420/MFANNv0.18-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 20, 2024 • 1

waltervix/OpenELM-3B-Instruct-Q4_K_M-GGUF

3B • Updated Jul 20, 2024 • 2

waltervix/OpenELM-3B-Instruct-Q8_0-GGUF

3B • Updated Jul 20, 2024 • 2

waltervix/OpenELM-3B-Instruct-Q2_K-GGUF

3B • Updated Jul 20, 2024 • 4 • 1

bunnycore/Llama-3-Intermix-Q5_K_M-GGUF

8B • Updated Jul 20, 2024 • 1

NikolayKozloff/llama-3-Nephilim-v3-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 20, 2024 • 13 • 2

Niansuh/gemma-2-9b-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 20, 2024 • 14

SteelQuants/G2-MS-Nyxora-27b-Q6_K-GGUF

27B • Updated Jul 20, 2024 • 9 • 1

SteelQuants/G2-MS-Nyxora-27b-Q4_K_M-GGUF

27B • Updated Jul 20, 2024 • 11 • 2

waltervix/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 5

Alex01837178373/T-lite-instruct-0.1-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 6

mudler/L3-8B-Celeste-V1.2-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 1

Alex01837178373/saiga_gemma2_9b_abliterated_sft_m2_d8-Q4_K_M-GGUF

9B • Updated Jul 20, 2024 • 28

Alex01837178373/saiga_gemma2_9b_abliterated_sft_m2_d8-Q5_K_M-GGUF

9B • Updated Jul 20, 2024 • 6

Niansuh/Llama-3-Groq-8B-Tool-Use-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 11

Alex01837178373/T-lite-instruct-0.1-Q5_K_M-GGUF

8B • Updated Jul 20, 2024 • 6

Alex01837178373/T-lite-instruct-0.1-abliterated-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 3