Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

Mungert/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Sep 24, 2025 • 240 • 1

Mungert/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Sep 24, 2025 • 191

Mungert/granite-3.2-8b-instruct-preview-GGUF

Text Generation • 8B • Updated Sep 24, 2025 • 107

Mungert/granite-3.1-2b-base-GGUF

3B • Updated Sep 24, 2025 • 32

taronaeo/Granite-3.1-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 66

taronaeo/Granite-3.3-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 237

Mungert/granite-3.0-2b-instruct-GGUF

Text Generation • 3B • Updated Sep 24, 2025 • 123

atcodespaceexplore/granite-3.3-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 10, 2025 • 6

SaisExperiments/granite-4.0-tiny-preview-Q8_0-GGUF

Text Generation • 7B • Updated Jul 11, 2025 • 5 • 1

bartowski/ibm-granite_granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Jul 11, 2025 • 482 • 5

mradermacher/granite-4.0-tiny-preview-GGUF

7B • Updated Jul 12, 2025 • 153

mradermacher/granite-4.0-tiny-base-preview-GGUF

7B • Updated Jul 12, 2025 • 132 • 1

mradermacher/granite-4.0-tiny-base-preview-i1-GGUF

7B • Updated Jul 12, 2025 • 98

mradermacher/granite-4.0-tiny-preview-i1-GGUF

7B • Updated Jul 12, 2025 • 80

Hoar012/TDC-Qwen2-7B

Updated Jul 22, 2025 • 6

Hoar012/TDC-Llama3_2-3B

Updated Jul 22, 2025 • 8

elichen-skymizer/granite-3.1-1b-a400m-base-Q8_0-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 6

elichen-skymizer/granite-3.1-1b-a400m-base-Q6_K-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 4

elichen-skymizer/granite-3.1-1b-a400m-base-Q5_K_M-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 3

elichen-skymizer/granite-3.1-1b-a400m-base-Q4_K_M-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 4

elichen-skymizer/granite-3.1-1b-a400m-base-Q3_K_M-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 8

elichen-skymizer/granite-4.0-tiny-base-preview-Q8_0-GGUF

7B • Updated Jul 17, 2025 • 3

elichen-skymizer/granite-4.0-tiny-base-preview-Q6_K-GGUF

7B • Updated Jul 17, 2025 • 8

elichen-skymizer/granite-4.0-tiny-base-preview-Q5_K_M-GGUF

7B • Updated Jul 17, 2025 • 6

elichen-skymizer/granite-4.0-tiny-base-preview-Q4_K_M-GGUF

7B • Updated Jul 17, 2025 • 6

elichen-skymizer/granite-4.0-tiny-base-preview-Q3_K_M-GGUF

7B • Updated Jul 17, 2025 • 5

tensorblock/RedHatAI_granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 10

Mungert/granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Sep 24, 2025 • 50 • 6

mradermacher/aquif-moe-400m-GGUF

1B • Updated Sep 7, 2025 • 88 • 1

mradermacher/aquif-moe-400m-i1-GGUF

1B • Updated Dec 18, 2025 • 31