Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,772

Base only

Active filters: llama-cpp

codegood/gemma-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 15, 2024 • 1.12k • 6

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

13B • Updated Apr 19, 2024 • 62 • 3

Xeolus/c4ai-command-r-v01-Q4_K_M-GGUF

35B • Updated Apr 14, 2024 • 81

bingbort/SOLAR-19.2B-Instruct-v1.0-Q4_K_M-GGUF

19B • Updated Apr 15, 2024 • 8

bingbort/bigstral-12b-v0.2-32k-Q6_K-GGUF

12B • Updated Apr 15, 2024 • 19

andreass123/EEVE-Korean-2.8B-v1.0-Q8_0-GGUF

3B • Updated Apr 15, 2024 • 12

andreass123/EEVE-Korean-Instruct-2.8B-v1.0-Q4_K_M-GGUF

3B • Updated Apr 15, 2024 • 18

andreass123/EEVE-Korean-Instruct-2.8B-v1.0-Q8_0-GGUF

3B • Updated Apr 15, 2024 • 15

gate369/Bitnet-M7-70m-Q8_0-GGUF

77.5M • Updated Apr 15, 2024 • 27 • 2

gate369/bitmap-mistral-alpaca-70m-Q8_0-GGUF

77.5M • Updated Apr 15, 2024 • 25

bingbort/Einstein_x_Dolphin-Q8_0-GGUF

7B • Updated Apr 15, 2024 • 12

bingbort/mergekit-slerp-vehkdva-Q8_0-GGUF

7B • Updated Apr 15, 2024 • 12

Desumor/WizardLM-2-7B-GGUF

7B • Updated Apr 15, 2024 • 6 • 3

Aryanne/WizardLM-2-7B-Q4_K_M-GGUF

7B • Updated Apr 15, 2024 • 12 • 3

RaincloudAi/WizardLM-2-7B-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 16

rabimba/Gemma-COT-Q4_K_M-GGUF

9B • Updated Apr 17, 2024 • 17

umarigan/TURKCELL-LLM-7B-DPO-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 13 • 1

NikolayKozloff/tweety-7b-italian-GGUF

Text Generation • 7B • Updated Apr 16, 2024 • 17 • 1

cybercheems2077/mistral-maths7B-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 23

NikolayKozloff/CodeQwen1.5-7B-Q8_0-GGUF

Text Generation • 7B • Updated Apr 16, 2024 • 19 • 4

SilverFan/WizardIceLemonTeaRP-7b-32k-GGUF

7B • Updated Apr 19, 2024 • 11

MythicalCow/llama2-7b-openhermes-15k-mini-Q4_K_M-GGUF

7B • Updated Apr 17, 2024 • 11

zypcastles/Qwen1.5-48B-Chat-Q6_K-GGUF

48B • Updated Apr 17, 2024 • 4

NikolayKozloff/DolphinLake-7B-Q8_0-GGUF

7B • Updated Apr 17, 2024 • 6 • 1

NikolayKozloff/Llama-portuguese-13b-Luana-v0.2-GGUF

Text Generation • 13B • Updated Apr 17, 2024 • 51 • 1

NikolayKozloff/Qwen-portuguese-luana-7b-GGUF

Text Generation • 8B • Updated Apr 17, 2024 • 25 • 1

NikolayKozloff/gemma-portuguese-luana-2b-GGUF

Text Generation • 3B • Updated Apr 17, 2024 • 84 • 2

MrAiran/pythia-13b-deduped-green_devil-Q4_K_M-GGUF

12B • Updated Apr 18, 2024 • 44

MrAiran/pythia-13b-deduped-green_devil-Q4_K_S-GGUF

12B • Updated Apr 18, 2024 • 19

Trisert/OrcaPlus-Q4_K_S-GGUF

14B • Updated Apr 18, 2024 • 8