Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,894

Base only

Active filters: llama.cpp

titantv090/GLM-4.7-Flash-Claude-Opus-4.6-High-Reasoning-Distill-GGUF

30B • Updated Mar 4 • 174 • 1

manuojvv/Qwen3.5-4B-gabliterated-Q8

Text Generation • 4B • Updated Mar 4 • 96 • 1

tejasgowda05/Kanoonu-AI-Phi3-GGUF

4B • Updated Mar 12 • 9 • 1

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated Mar 4 • 192 • 6

itryv/gwen-frontend-4b-GGUF

4B • Updated Mar 4 • 290

yanyao/roitium_echo

9B • Updated Mar 4 • 15

Redhanuman/Ankita-3B-Hinglish-v1-GGUF

3B • Updated Mar 4 • 18

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated May 16 • 193 • 4

ivanchaushiji/gemma-finetuned-ollama

0.3B • Updated Mar 4 • 21

Aakash098/ShinchanAI-small

Text Generation • 3B • Updated Mar 8 • 11

Lijr2002/e_emotion

8B • Updated Mar 6 • 11

madox81/SmolLM2-Cyber-Insight-GGUF

2B • Updated Mar 4 • 18

fjhghfghdfg/dotexeai

4B • Updated Mar 4 • 17

FloatDo/exaone-4.0-1.2b-float-right-tagger-GGUF

1B • Updated Mar 4 • 18

TheEpTic/IQuest-Coder-V1-7B-Instruct-GGUF

Text Generation • 8B • Updated Mar 4 • 1.95k

TheEpTic/IQuest-Coder-V1-7B-Thinking-GGUF

Text Generation • 8B • Updated Mar 4 • 39 • 1

jimmm1212/my_expert_llama3

8B • Updated Mar 4 • 14

BricksDisplay/Soprano-1.1-80M-GGUF

Text-to-Speech • 30.4M • Updated Apr 30 • 195

chhatramani/nyayalm_v0.2_7task_GGUF

2B • Updated Mar 4 • 11

FloatDo/EXAONE-3.5-2.4B-Instruct-GGUF

2B • Updated Mar 4 • 28

FloatDo/EXAONE-3.5-7.8B-Instruct-GGUF

8B • Updated Mar 5 • 13

FloatDo/EXAONE-3.5-32B-Instruct-GGUF

32B • Updated Mar 5 • 28

FloatDo/EXAONE-Deep-7.8B-GGUF

8B • Updated Mar 5 • 23

FloatDo/EXAONE-Deep-32B-GGUF

32B • Updated Mar 5 • 12

rudycaz/qwen35-27b-phish-finetuned-gguf

Text Generation • 27B • Updated Mar 4 • 29

Phonepadith/gemma-3n-laos-fine-tuned

8B • Updated Mar 8 • 33

FloatDo/EXAONE-Deep-2.4B-GGUF

2B • Updated Mar 5 • 23

hans00/kani-tts-2-GGUF

Text-to-Speech • 68.6M • Updated May 2 • 51

AntoineChatry/mistral-7b-python

7B • Updated Mar 4 • 19

megabytes/Home-Qwen3.5-0.8B-v0-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 4 • 91