Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,044

Base only

Active filters: uk

matrixportalx/Phi-4-mini-instruct-Q3_K_L-GGUF

Text Generation • 4B • Updated Mar 3, 2025 • 9

matrixportalx/Phi-4-mini-instruct-Q4_0-GGUF

Text Generation • 4B • Updated Mar 3, 2025 • 37

matrixportalx/Phi-4-mini-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Mar 3, 2025 • 12

RedHatAI/Phi-4-mini-instruct-FP8-dynamic

Text Generation • 4B • Updated Apr 28 • 763 • 1

fdcmasta/test

Updated Mar 4, 2025

harisnaeem/Phi-4-mini-instruct-GGUF-Q8

Text Generation • 4B • Updated Mar 4, 2025 • 17

alexgusevski/Phi-4-mini-instruct-Q2-mlx

Text Generation • 0.4B • Updated Mar 4, 2025 • 12

alexgusevski/Phi-4-mini-instruct-q3-mlx

Text Generation • 0.5B • Updated Mar 4, 2025 • 13

alexgusevski/Phi-4-mini-instruct-Q4-mlx

Text Generation • 0.6B • Updated Mar 4, 2025 • 10

alexgusevski/Phi-4-mini-instruct-Q6-mlx

Text Generation • 0.8B • Updated Mar 4, 2025 • 11

alexgusevski/Phi-4-mini-instruct-Q8-mlx

Text Generation • 1B • Updated Mar 4, 2025 • 9

mradermacher/DATA-AI_Chat_3_1B-GGUF

1B • Updated Mar 6, 2025 • 121

mradermacher/salamandraTA-7b-instruct-GGUF

8B • Updated 9 days ago • 1.01k • 1

mlx-community/aya-vision-8b-4bit

Image-Text-to-Text • 2B • Updated Mar 5, 2025 • 37 • 1

mlx-community/aya-vision-8b-3bit

Image-Text-to-Text • 1B • Updated Mar 5, 2025 • 18 • 1

mlx-community/aya-vision-8b-6bit

Image-Text-to-Text • 2B • Updated Mar 5, 2025 • 28 • 2

mlx-community/aya-vision-8b-8bit

Image-Text-to-Text • 3B • Updated Mar 5, 2025 • 108 • 3

mlx-community/aya-vision-8b-bf16

Image-Text-to-Text • 9B • Updated Mar 5, 2025 • 11

mlx-community/aya-vision-32b-4bit

Image-Text-to-Text • 6B • Updated Mar 5, 2025 • 6

mlx-community/aya-vision-32b-3bit

Image-Text-to-Text • 5B • Updated Mar 5, 2025 • 9

mlx-community/aya-vision-32b-6bit

Image-Text-to-Text • 8B • Updated Mar 5, 2025 • 10

mlx-community/aya-vision-32b-8bit

Image-Text-to-Text • 10B • Updated Mar 5, 2025 • 18 • 1

mlx-community/aya-vision-32b-bf16

Image-Text-to-Text • 33B • Updated Mar 5, 2025 • 24 • 1

nickk256/Phi-4-mini-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Mar 5, 2025 • 11

richsnow/Phi-4-mini-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Mar 5, 2025 • 24

KYUNGYONG/aya-expanse-32b-abliterated-Q4-mlx

Text Generation • 5B • Updated Mar 5, 2025 • 52

mobeidat/c4ai-command-r7b-arabic-02-2025-Q4_K_M-GGUF

8B • Updated Mar 5, 2025 • 40

h3artbrake/Phi-4-mini-instruct-Q4-mlx

Text Generation • 0.6B • Updated Mar 5, 2025 • 56

KYUNGYONG/aya-expanse-8b-abliterated-Q4-mlx

Text Generation • 1B • Updated Mar 5, 2025 • 24

sebtc/Phi-4-mini-instruct-Q8-mlx

Text Generation • 1B • Updated Mar 5, 2025 • 12