Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

mradermacher/granite-3.1-8b-instruct-abliterated-i1-GGUF

8B • Updated Dec 21, 2024 • 44 • 5

CreativeAlloyYT/FrenchLlama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Apr 1, 2025 • 167 • 1

bartowski/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 1.71k • 2

itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 32

itlwas/granite-3.1-2b-base-Q4_K_M-GGUF

3B • Updated Dec 23, 2024 • 17

itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 31

itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 19

itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 17

itlwas/granite-3.1-1b-a400m-base-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 15

itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 23, 2024 • 23

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

8B • Updated Dec 23, 2024 • 32

itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 8

itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 16

Novaciano/Granite-3.1-1b-NSFW_Amoral_Christmas-GGUF

Text Generation • 1B • Updated Dec 25, 2024 • 57

tensorblock/granite-3.1-3b-a800m-base-GGUF

Text Generation • 3B • Updated Jan 27 • 95

tensorblock/granite-3.1-1b-a400m-base-GGUF

Text Generation • 1B • Updated Jan 27 • 56

tensorblock/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Jan 27 • 96

tensorblock/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 69

tensorblock/granite-3.1-8b-base-GGUF

8B • Updated Jan 27 • 53

tensorblock/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 89

tensorblock/granite-3.1-2b-base-GGUF

3B • Updated Jan 27 • 32

tensorblock/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 43 • 1

msyukorai/granite-3.1-2b-instruct-Q4_0-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 8

lamm-mit/Graph-Preflexor_01062025

Text Generation • 4B • Updated Jan 17, 2025 • 14 • 12

vikram-fresche/granite-3.1-8b-instruct

Text Generation • 8B • Updated Jan 18, 2025 • 7

mradermacher/granite-3.0-3b-a800m-base-GGUF

3B • Updated Jan 16, 2025 • 99

mradermacher/granite-3.0-1b-a400m-base-GGUF

1B • Updated Jan 15, 2025 • 15

mradermacher/granite-3.0-2b-base-GGUF

3B • Updated Jan 15, 2025 • 18

mradermacher/granite-3.0-1b-a400m-base-i1-GGUF

1B • Updated Jan 15, 2025 • 134

mradermacher/granite-3.0-8b-base-GGUF

8B • Updated Jan 15, 2025 • 45