Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

434

Base only

Active filters: local-ai

Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed

Text Generation • 6B • Updated about 13 hours ago • 39

Youssofal/Qwen3.8-27B-MTPLX-Optimized-Quality

Text Generation • 8B • Updated about 13 hours ago • 20

Youssofal/Qwen3.8-27B-MTPLX-Bare-Speed

Text Generation • 4B • Updated about 13 hours ago • 6 • 8

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-V2

Text Generation • 6B • Updated 4 days ago • 2.14k • 6

Youssofal/Qwen3.8-27B-MTPLX-Bare-Speed-FP16

Text Generation • 4B • Updated about 12 hours ago • 3

Youssofal/Qwen3.8-27B-MTPLX-Optimized-Quality-FP16

Text Generation • 8B • Updated about 12 hours ago • 3

TurboAiLabs/turbo-ai-7b

Text Generation • 8B • Updated 29 days ago • 453 • 2

shafire/OpenZero-Gemma4-E2B-Agentic-GGUF

Text Generation • 5B • Updated 5 days ago • 504 • 3

shafire/OpenZero-Ministral3-8B-Runtime-Agent-GGUF

Text Generation • 8B • Updated about 5 hours ago • 125 • 2

Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed-FP16

Text Generation • 6B • Updated about 12 hours ago • 2

aiplatforms/ru-male-friend-roleplay-mini-gguf

Text Generation • 2B • Updated May 7 • 205 • 2

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated Jun 11 • 1.25k • 5

ddalcu/Qwen3.6-27B-4bit-MTP-MLX-Serve

Text Generation • 5B • Updated Jun 11 • 701 • 4

mradermacher/turbo-ai-7b-GGUF

Summarization • 8B • Updated Jul 11 • 156 • 1

mradermacher/turbo-ai-7b-i1-GGUF

Summarization • 8B • Updated Jul 11 • 553 • 2

lucasbischofchaperon/Sophia-v2

Text Generation • 8B • Updated Jul 12 • 483 • 1

Subject-Emu-5259/NeuralAI-Mamba-K1

Text Generation • 0.1B • Updated 2 days ago • 1.46k • 1

shafire/OpenZero-Fusion-Qwen3-4B-Agentic-GGUF

Text Generation • 4B • Updated 4 days ago • 456 • 1

shafire/OpenZero-Qwen3-1.7B-Agentic-GGUF

Text Generation • 2B • Updated 5 days ago • 241 • 1

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebula

Text Generation • Updated May 10

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebulal

Text Generation • Updated May 10 • 9

Agnuxo/Mistral-NeMo-Minitron-8B-Base-CODE-Python

Text Generation • Updated May 10 • 4

mradermacher/Mistral-NeMo-Minitron-8B-Base-Nebulal-GGUF

Text Generation • 8B • Updated Jun 13 • 110

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-8bit

Text Generation • 8B • Updated May 10 • 82

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-16bit

Text Generation • 8B • Updated May 10 • 145

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-4bit

Text Generation • Updated May 10

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-16bit

Text Generation • Updated May 10 • 5 • 1

Agnuxo/Meta-Llama-3.1-8B-CODE-Alpaca-Python-8bit-GGUF

Text Generation • 8B • Updated May 10 • 68

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-Alpaca-Lora

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-lora_model

Text Generation • Updated May 10