Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q6_K-GGUF

Text Generation • 3B • Updated Feb 17, 2025 • 6

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Feb 17, 2025 • 18

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 9

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 15

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 8

ibm-granite/granite-3.2-2b-instruct

Text Generation • 3B • Updated Apr 17, 2025 • 6.96k • 53

ibm-granite/granite-3.2-8b-instruct

Text Generation • 8B • Updated Apr 17, 2025 • 3.18k • 92

Novaciano/Granite-3.1-1b-ANAL_DESTRUCTION-GGUF

Text Generation • 1B • Updated Feb 18, 2025 • 7 • 2

ObeJ/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 18, 2025 • 13

mradermacher/granite-3.2-8b-instruct-preview-i1-GGUF

8B • Updated Feb 19, 2025 • 91 • 1

gety-ai/granite-embedding-107m-multilingual-onnx

Sentence Similarity • Updated Feb 19, 2025 • 40 • 4

dewdev/language_detection

Text Classification • 24.5M • Updated Feb 26, 2025 • 47 • 1

mradermacher/seal-7b-chat-GGUF

Text Generation • 7B • Updated Feb 25, 2025 • 121

mradermacher/seal-7b-chat-i1-GGUF

Text Generation • 7B • Updated Feb 25, 2025 • 102

ibm-research/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Mar 3, 2025 • 369 • 10

ibm-research/granite-3.2-2b-instruct-GGUF

Text Generation • 3B • Updated Mar 28, 2025 • 841 • 12

kubernetes-bad/Conpono

Updated Feb 26, 2025 • 37

bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 1.38k • 5

lmstudio-community/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 4.67k • 3

bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF

Text Generation • 3B • Updated Feb 26, 2025 • 1.19k • 4

lmstudio-community/granite-3.2-2b-instruct-GGUF

Text Generation • 3B • Updated Feb 26, 2025 • 178 • 1

CISCai/granite-3.2-8b-instruct-SOTA-GGUF

Text Generation • 8B • Updated Feb 27, 2025 • 270

NikolayKozloff/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 2 • 1

NikolayKozloff/granite-3.2-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Feb 26, 2025 • 13 • 1

alexgusevski/granite-3.2-2b-instruct-q3-mlx

Text Generation • 0.3B • Updated Feb 26, 2025 • 8

alexgusevski/granite-3.2-2b-instruct-q4-mlx

Text Generation • 0.4B • Updated Feb 26, 2025 • 10 • 1

alexgusevski/granite-3.2-2b-instruct-q6-mlx

Text Generation • 0.6B • Updated Feb 26, 2025 • 9

alexgusevski/granite-3.2-2b-instruct-q8-mlx

Text Generation • 0.7B • Updated Feb 26, 2025 • 5

cgus/granite-3.2-2b-instruct-exl2

Text Generation • Updated Feb 26, 2025 • 12

alexgusevski/granite-3.2-2b-instruct-mlx

Text Generation • 3B • Updated Feb 26, 2025 • 8