Edit Models filters

Model Tree

google/gemma-2-2b-it

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

187

Base only

Active filters: google/gemma-2-2b-it

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.99k • 9

mlc-ai/gemma-2-2b-it-q4f16_1-MLC

Updated Sep 7, 2025 • 8.74k • 7

google/gemma-2-2b-it-GGUF

3B • Updated Aug 27, 2024 • 142 • 92

Fizzarolli/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 12

kaetemi/gemma-2-2b-it-Q4_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 38

Wusul/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 18

bartowski/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 206k • 100

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 7.18k • 22

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.06k • 1

newsletter/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 103

roshanai/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 60 • 2

mlc-ai/gemma-2-2b-it-q0f32-MLC

Updated Sep 7, 2025

mlc-ai/gemma-2-2b-it-q4f32_1-MLC

Updated Sep 7, 2025 • 366

mlc-ai/gemma-2-2b-it-q0f16-MLC

Updated Sep 7, 2025

NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 19 • 1

ac3xx/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 33

ac3xx/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 20

Kondara/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 6

Kondara/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 15

ironlanderl/gemma-2-2b-it-Q5_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 48

polyverse/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 286

second-state/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 6, 2024 • 273 • 1

gaianet/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 46

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 78.9k • 14

mrmage/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 15

joehirstdev/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 16 • 1

mrmage/gemma-2-2b-it-Q3_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 21

qnixsynapse/Gemma-V2-2B-Instruct-GGUF

Text Generation • 3B • Updated Aug 13, 2024 • 20

cha9ro/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 15

wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 26