Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

145

Base only

Active filters: ibm

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 11

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025 • 12

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025 • 12

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 14

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025 • 13

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025 • 15

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025 • 10

Mungert/granite-7b-instruct-GGUF

Text Generation • 7B • Updated Sep 24, 2025 • 28

mlx-community/granite-4.0-h-tiny-3bit-MLX

Text Generation • 0.9B • Updated Oct 3, 2025 • 72 • 2

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • 7B • Updated Oct 3, 2025 • 50 • 1

mlx-community/granite-4.0-h-tiny-5bit-MLX

Text Generation • 1B • Updated Oct 3, 2025 • 31 • 2

xJoePec/galena-2b-math-physics

Text Generation • 3B • Updated Nov 18, 2025 • 36 • 1

TevunahAi/granite-8b-code-instruct-4k-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 16

TevunahAi/granite-20b-code-instruct-8k-FP8

Text Generation • 20B • Updated Dec 8, 2025 • 9

TevunahAi/granite-34b-code-instruct-8k-FP8

Text Generation • 34B • Updated Dec 8, 2025 • 6

TevunahAi/granite-8b-code-instruct-4k-2048-Calibration-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 5

TevunahAi/granite-20b-code-instruct-8k-2048-Calibration-FP8

Text Generation • 20B • Updated Dec 8, 2025 • 7

TevunahAi/Granite-34B-Code-Instruct-8k-2048-Calibration-FP8

Text Generation • 34B • Updated Dec 8, 2025 • 8

TevunahAi/Granite-3.3-8B-Instruct-GPTQ

Text Generation • 8B • Updated Jan 4 • 12

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B

Text Generation • 2B • Updated Mar 29 • 37

oki692/granite-7b-lab-GGUF

Updated Mar 29 • 6

11-47/IBM-GPT5.4-Coder-1B

Text Generation • 2B • Updated Mar 29 • 25 • 3

mradermacher/IBM-Grok4-UltraFast-Coder-1B-GGUF

Text Generation • 2B • Updated Apr 22 • 1.23k • 2

mradermacher/IBM-GPT-5.4-Coder-1B-GGUF

Text Generation • 2B • Updated Jun 1 • 100

mradermacher/IBM-GPT-5.4-Coder-1B-i1-GGUF

Text Generation • 2B • Updated Jun 1 • 506 • 1

introvoyz041/biomed.omics.bl.sm.ma-ted-458m

0.5B • Updated Apr 1 • 8

introvoyz041/biomed.omics.bl.sm.ma-ted-458m.protein_solubility

0.5B • Updated Apr 1 • 12

coml/hubert-base-mmsulab

94.4M • Updated Apr 24 • 20

Oxy29/IBM-GPT5.4-Coder-1B

Text Generation • 2B • Updated Apr 26 • 12 • 2