Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,785

Base only

Active filters: instruct

mradermacher/MamayLM-Gemma-3-12B-IT-v1.0-GGUF

12B • Updated Sep 28, 2025 • 280 • 2

mradermacher/MamayLM-Gemma-3-4B-IT-v1.0-i1-GGUF

4B • Updated Dec 7, 2025 • 490 • 3

mradermacher/MamayLM-Gemma-3-12B-IT-v1.0-i1-GGUF

12B • Updated Jul 19 • 826 • 2

mradermacher/Hermes-4-405B-i1-GGUF

19.1M • Updated Dec 7, 2025 • 2

Edith08/llama-for-kathakali

Text Generation • Updated Dec 24, 2025 • 4

mlx-community/granite-4.0-h-tiny-3bit-MLX

Text Generation • 0.9B • Updated Oct 3, 2025 • 80 • 2

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • 7B • Updated Oct 3, 2025 • 30 • 1

mlx-community/granite-4.0-h-tiny-5bit-MLX

Text Generation • 1B • Updated Oct 3, 2025 • 36 • 2

softjapan/softjapan-model-gguf

Text Generation • 3B • Updated Oct 3, 2025 • 14

marcosremar2/runpod_serverless_n2

Text Generation • 0.5B • Updated Oct 5, 2025 • 6

ValiantLabs/Qwen3-4B-Thinking-2507-Esper3.1

Text Generation • 4B • Updated Apr 22 • 20 • 8

Savyasaachin/Qwen3-Shining-Lucy-CODER-3.4B-Brainstorm20x-e32-Q8_0-GGUF

Text Generation • 3B • Updated Oct 7, 2025 • 33 • 1

mlx-community/LFM2-8B-A1B-8bit-MLX

Text Generation • 8B • Updated Oct 8, 2025 • 70 • 7

mlx-community/LFM2-8B-A1B-6bit-MLX

Text Generation • 8B • Updated Oct 8, 2025 • 24 • 3

mradermacher/Qwen3-4B-Thinking-2507-Esper3.1-GGUF

4B • Updated Oct 8, 2025 • 190 • 3

mradermacher/Qwen3-4B-Thinking-2507-Esper3.1-i1-GGUF

4B • Updated Dec 9, 2025 • 271 • 2

mlx-community/LFM2-8B-A1B-3bit-MLX

Text Generation • 1B • Updated Oct 8, 2025 • 120 • 2

yaraabdalaziz/SmolLM2Instruct-360-FT-MealRecommendation-v1

Text Generation • 0.4B • Updated Oct 9, 2025 • 10

yaraabdalaziz/SmolLM2Instruct-FT-MealRecommendation-v3

Text Generation • 0.1B • Updated Oct 9, 2025 • 7 • 1

EmanuelOverride/wise-llama-Q4_K_M-GGUF

8B • Updated Oct 11, 2025 • 5

Babsie/DeepHermes3_24B_textonly

24B • Updated Oct 27, 2025 • 9 • 1

philkuz/llama-3.3-70b-instruct-fp8

Text Generation • 71B • Updated Oct 14, 2025 • 13 • 1

mradermacher/DeepHermes-Egregore-8B-131K-GGUF

Reinforcement Learning • 8B • Updated Oct 16, 2025 • 101 • 1

mradermacher/DeepHermes-Egregore-8B-131K-i1-GGUF

Reinforcement Learning • 8B • Updated Dec 10, 2025 • 179 • 1

tbilisi-ai-lab/kona2-12B-Instruct

Text Generation • 12B • Updated May 16 • 31 • 4

SaptivaAI/KAL-24B-mx-v1

Text Generation • 22B • Updated Oct 18, 2025 • 20 • 10

Gokul-A-100/llama-3.1-8B-Instruct-atty-finetuned

Text Generation • Updated Oct 18, 2025

mradermacher/KAL-24B-mx-v1-GGUF

Text Generation • 22B • Updated Oct 19, 2025 • 72

mradermacher/kona2-12B-Instruct-GGUF

12B • Updated Jun 9 • 89

mradermacher/KAL-24B-mx-v1-i1-GGUF

Text Generation • 22B • Updated Dec 6, 2025 • 256