Instructions to use google/gemma-4-12B-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/gemma-4-12B-it with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("google/gemma-4-12B-it") model = AutoModelForImageTextToText.from_pretrained("google/gemma-4-12B-it") - Notebooks
- Google Colab
- Kaggle
vllm support?
#32
by mohamedemam - opened
does it run on vllm ?
Hi @mohamedemam
yes , please check these https://recipes.vllm.ai/Google/gemma-4-12B-it
https://docs.vllm.ai/projects/recipes/en/latest/Google/Gemma4.html
Thanks