Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,776

Base only

Active filters: llama-cpp

mjschock/TinySolar-248m-4k-py-Q4_K_M-GGUF

0.2B • Updated Jul 19, 2024 • 9 • 1

NikolayKozloff/L3-8B-Celeste-V1.2-Q8_0-GGUF

8B • Updated Jul 19, 2024 • 2 • 2

Guilherme34/Samantha-qwen-0.5b-ptbr-Q8_0-GGUF

0.5B • Updated Jul 19, 2024 • 4

Guilherme34/Samantha-MoE-Q4_K_M-GGUF

13B • Updated Jul 19, 2024 • 4 • 1

Guilherme34/Samantha-MoE-Q2_K-GGUF

13B • Updated Jul 19, 2024 • 7

AlexLee00/solar_v01-Q4_K_M-GGUF

11B • Updated Jul 20, 2024 • 6

netcat420/MFANNv0.18-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 20, 2024 • 2

waltervix/OpenELM-3B-Instruct-Q4_K_M-GGUF

3B • Updated Jul 20, 2024 • 8

waltervix/OpenELM-3B-Instruct-Q8_0-GGUF

3B • Updated Jul 20, 2024 • 5

waltervix/OpenELM-3B-Instruct-Q2_K-GGUF

3B • Updated Jul 20, 2024 • 18 • 1

bunnycore/Llama-3-Intermix-Q5_K_M-GGUF

8B • Updated Jul 20, 2024 • 7

NikolayKozloff/llama-3-Nephilim-v3-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 20, 2024 • 7 • 2

Niansuh/gemma-2-9b-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 20, 2024 • 18

SteelQuants/G2-MS-Nyxora-27b-Q6_K-GGUF

27B • Updated Jul 20, 2024 • 9 • 1

SteelQuants/G2-MS-Nyxora-27b-Q4_K_M-GGUF

27B • Updated Jul 20, 2024 • 11 • 2

waltervix/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jul 20, 2024 • 7

Alex01837178373/T-lite-instruct-0.1-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 6

mudler/L3-8B-Celeste-V1.2-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 2

Alex01837178373/saiga_gemma2_9b_abliterated_sft_m2_d8-Q4_K_M-GGUF

9B • Updated Jul 20, 2024 • 48

Alex01837178373/saiga_gemma2_9b_abliterated_sft_m2_d8-Q5_K_M-GGUF

9B • Updated Jul 20, 2024 • 23

Niansuh/Llama-3-Groq-8B-Tool-Use-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 7

Alex01837178373/T-lite-instruct-0.1-Q5_K_M-GGUF

8B • Updated Jul 20, 2024 • 2

Alex01837178373/T-lite-instruct-0.1-abliterated-Q4_K_M-GGUF

8B • Updated Jul 20, 2024 • 3

Alex01837178373/T-lite-instruct-0.1-abliterated-Q5_K_M-GGUF

8B • Updated Jul 20, 2024 • 5

Alex01837178373/T-lite-instruct-0.1-abliterated-Q8_0-GGUF

8B • Updated Jul 20, 2024 • 53

sashkoangelov/Mistral-7B-v0.1-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 20, 2024 • 4

Wusul/TinyLlama_v1.1-Q6_K-GGUF

1B • Updated Jul 21, 2024 • 2

Tremontaine/G2-MS-Nyxora-27b-Q5_K_M-GGUF

27B • Updated Jul 21, 2024 • 17

dasbd72/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 3

AndreasThinks/mistral-7b-english-welsh-translate-GGUF

7B • Updated Jul 22, 2024 • 15