Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

bartowski/granite-embedding-278m-multilingual-GGUF

Text Generation • 0.3B • Updated Dec 23, 2024 • 605 • 8

lmstudio-community/granite-embedding-278m-multilingual-GGUF

Text Generation • 0.3B • Updated Dec 23, 2024 • 270 • 4

jncraton/granite-embedding-30m-english-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 39

jncraton/granite-embedding-125m-english-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 39

jncraton/granite-embedding-107m-multilingual-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 32

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 31

QuantFactory/granite-3.1-2b-base-GGUF

3B • Updated Dec 19, 2024 • 181 • 3

QuantFactory/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 168 • 4

QuantFactory/granite-3.1-3b-a800m-base-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 82 • 3

QuantFactory/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 95 • 7

QuantFactory/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 117 • 4

QuantFactory/granite-3.1-1b-a400m-base-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 174 • 6

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 148 • 7

mradermacher/granite-3.1-1b-a400m-base-GGUF

1B • Updated Dec 21, 2024 • 95

mradermacher/granite-3.1-1b-a400m-instruct-GGUF

1B • Updated Dec 21, 2024 • 76

mradermacher/granite-3.1-2b-base-GGUF

3B • Updated Dec 21, 2024 • 54

mradermacher/granite-3.1-2b-instruct-GGUF

3B • Updated Dec 20, 2024 • 104

mradermacher/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 98

mradermacher/granite-3.1-8b-instruct-GGUF

8B • Updated Dec 20, 2024 • 104 • 1

mradermacher/granite-3.1-1b-a400m-base-i1-GGUF

1B • Updated Dec 21, 2024 • 124

mradermacher/granite-3.1-8b-instruct-i1-GGUF

8B • Updated Feb 13, 2025 • 152 • 2

mradermacher/granite-3.1-1b-a400m-instruct-i1-GGUF

1B • Updated Dec 21, 2024 • 81 • 3

mradermacher/granite-3.1-2b-instruct-i1-GGUF

3B • Updated Dec 20, 2024 • 138

mradermacher/granite-3.1-2b-base-i1-GGUF

3B • Updated Dec 21, 2024 • 186

QuantFactory/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 36 • 3

mradermacher/granite-3.1-8b-base-i1-GGUF

8B • Updated Dec 20, 2024 • 140

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Dec 21, 2024 • 17

huihui-ai/granite-3.1-2b-instruct-abliterated

Text Generation • 3B • Updated Dec 21, 2024 • 25 • 3

mradermacher/granite-3.1-8b-instruct-abliterated-GGUF

8B • Updated Dec 21, 2024 • 71 • 3

mradermacher/granite-3.1-2b-instruct-abliterated-GGUF

3B • Updated Dec 21, 2024 • 77