How to use coolthor/gemma-4-12B-it-FP8-dynamic with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("coolthor/gemma-4-12B-it-FP8-dynamic") model = AutoModelForMultimodalLM.from_pretrained("coolthor/gemma-4-12B-it-FP8-dynamic")
coolthor commited on 