Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,591

Base only

Active filters: llama-cpp

morris891205/llama3_Doctor_finetune-Q4_K_M-GGUF

8B • Updated May 28, 2024 • 9

joshnader/Phi-3-medium-128k-instruct-Q4_K_M-GGUF

Text Generation • 14B • Updated May 28, 2024 • 6

joshnader/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated May 28, 2024 • 12

Ransss/llama-3-Daredevil-Mahou-8B-Q8_0-GGUF

8B • Updated May 28, 2024 • 26

Ransss/Halu-8B-Llama3-Blackroot-Q8_0-GGUF

8B • Updated May 28, 2024 • 22

Ransss/SOVLish-Devil-8B-L3-Q8_0-GGUF

8B • Updated May 28, 2024 • 17

kopalja/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated May 28, 2024 • 21

xX-FANE-Xx/Mixtral-8x7B-Instruct-v0.1-Q2_K-GGUF

47B • Updated May 28, 2024 • 1

Ransss/Neural-SOVLish-Devil-8B-L3-Q8_0-GGUF

8B • Updated May 28, 2024 • 19

beansandbytes/Llama3-German-8B-Q4_K_M-GGUF

8B • Updated May 28, 2024 • 15

beansandbytes/Llama3-DiscoLeo-Instruct-8B-v0.1-Q4_K_M-GGUF

8B • Updated May 28, 2024 • 23

arnavchopraa/gemma-7b-Q4_K_M-GGUF

9B • Updated May 28, 2024 • 19

2sy1227/gemma_2b_ko_summary-Q4_K_M-GGUF

3B • Updated Jun 4, 2024 • 22

arnavchopraa/Meta-Llama-3-8B-Q4_K_S-GGUF

Text Generation • 8B • Updated May 28, 2024 • 15

ybelkada/tiny-random-llama-Q6_K-GGUF

1.03M • Updated May 28, 2024 • 8

ybelkada/test-gguf-trainer-Q8_0-GGUF

1.03M • Updated May 28, 2024 • 33

ClaudioItaly/TopEvolution-Q8_0-GGUF

7B • Updated May 28, 2024 • 35

franciscobdl/EstigiaxTinyLlama1.2-Q5_K_M-GGUF

1B • Updated Jun 23, 2024 • 6

Ransss/Xwin-MLewd-13B-V0.2-Q8_0-GGUF

13B • Updated May 28, 2024 • 12

Ransss/Xwin-MLewd-13B-V0.2-Q6_K-GGUF

13B • Updated May 28, 2024 • 2

NikolayKozloff/Alpha-Ophiuchi-mini-128k-v0.1-Q4_0-GGUF

4B • Updated May 28, 2024 • 52 • 1

NikolayKozloff/Alpha-Ophiuchi-mini-128k-v0.1-Q5_0-GGUF

4B • Updated May 28, 2024 • 45 • 1

Ransss/MLewdBoros-L2-13B-Q6_K-GGUF

13B • Updated May 28, 2024 • 2

Ransss/Unholy-v1-12L-13B-Q6_K-GGUF

13B • Updated May 28, 2024 • 7 • 1

Ransss/MLewdBoros-LRPSGPT-2Char-13B-Q6_K-GGUF

13B • Updated May 28, 2024 • 6

Ransss/Amethyst-13B-Q6_K-GGUF

13B • Updated May 28, 2024 • 8

Unsterile/daybreak-kunoichi-2dpo-7b-Q5_K_M-GGUF

7B • Updated May 28, 2024 • 13 • 1

Unsterile/daybreak-kunoichi-2dpo-7b-Q6_K-GGUF

7B • Updated May 28, 2024 • 5 • 2

Unsterile/daybreak-kunoichi-2dpo-7b-Q8_0-GGUF

7B • Updated May 28, 2024 • 3 • 2

Waywardr/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 28, 2024 • 11