Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

introvoyz041/granite-4.0-h-350m-mlx-4Bit

Text Generation • 53.5M • Updated Nov 29, 2025 • 8

introvoyz041/granite-4.0-h-tiny-mlx-4Bit

Text Generation • 1B • Updated Nov 29, 2025 • 16

introvoyz041/granite-4.0-350m-mlx-4Bit

Text Generation • 55.1M • Updated Nov 29, 2025 • 5

introvoyz041/granite-4.0-micro-mlx-4Bit

Text Generation • 0.5B • Updated Nov 29, 2025 • 12

mradermacher/aquif-3.5-Max-1205-GGUF

42B • Updated Dec 7, 2025 • 66 • 3

mradermacher/aquif-3.5-Max-1205-i1-GGUF

42B • Updated Dec 7, 2025 • 76

bartowski/aquif-ai_aquif-3.5-Max-1205-GGUF

Text Generation • 42B • Updated Dec 7, 2025 • 1.15k

mradermacher/neo-64M-C1-GGUF

64.1M • Updated Dec 9, 2025 • 266

mradermacher/neo-2-345M-C2-GGUF

0.4B • Updated Dec 9, 2025 • 398

mradermacher/neo-2-345M-C1-GGUF

0.4B • Updated Dec 9, 2025 • 56

Edge-Quant/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 10, 2025 • 22

DrRiceIO7/granite-4.0-micro-heretic

Text Generation • 3B • Updated Dec 19, 2025 • 7 • 2

Edge-Quant/granite-4.0-350m-Q8_0-GGUF

0.4B • Updated Dec 11, 2025 • 9

mradermacher/granite-4.0-h-small-heretic_hi-GGUF

32B • Updated Dec 13, 2025 • 81

mradermacher/granite-4.0-h-small-heretic_hi-i1-GGUF

32B • Updated Dec 13, 2025 • 184

kordelfrance/task-guidance-multimodal-dataset

Robotics • Updated Dec 13, 2025

Wwayu/granite-4.0-h-small-heretic_hi-mlx-8Bit

Text Generation • 32B • Updated Dec 15, 2025 • 20

mradermacher/granite-4.0-micro-heretic-GGUF

3B • Updated Dec 17, 2025 • 65 • 1

mradermacher/granite-4.0-micro-heretic-i1-GGUF

3B • Updated Dec 17, 2025 • 145 • 1

barflyman/granite-4.0-1b-ONNX-web

Text Generation • Updated Dec 21, 2025 • 5

jon7009/granite-4.0-350m-Q4_K_M-GGUF

0.4B • Updated Dec 24, 2025 • 12

platforms-aisg/granite-4.0-h-small-mlx-4Bit

Text Generation • 32B • Updated Dec 29, 2025 • 14

platforms-aisg/granite-4.0-h-small-mlx-8Bit

Text Generation • 32B • Updated Dec 29, 2025 • 12

mradermacher/granite-4.0-h-small-heretic_med-GGUF

32B • Updated Dec 29, 2025 • 42

mradermacher/granite-4.0-h-small-heretic_lo-GGUF

32B • Updated Dec 30, 2025 • 55

mradermacher/granite-4.0-h-small-heretic_med-i1-GGUF

32B • Updated Dec 30, 2025 • 104

mradermacher/granite-4.0-h-small-heretic_lo-i1-GGUF

32B • Updated Dec 30, 2025 • 156

raul3820/granite-30m-sparse-onnx

Feature Extraction • 30.3M • Updated Jan 3 • 4

sand-r/granite-3.3-2b-instruct-openvino

Text Generation • Updated Jan 4 • 6

TheDrewBenson/granite-4.0-h-micro-Q3-MLX

Text Generation • 0.4B • Updated Jan 19 • 4