How to use RedHatAI/gemma-3n-E2B-it-quantized.w4a16 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("RedHatAI/gemma-3n-E2B-it-quantized.w4a16", dtype="auto")
mtobing