Instructions to use RedHatAI/gemma-3n-E2B-it-quantized.w4a16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use RedHatAI/gemma-3n-E2B-it-quantized.w4a16 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("RedHatAI/gemma-3n-E2B-it-quantized.w4a16", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
Update README.md 82c3646 verified
Delete lighteval_results dd24e9c verified
Upload model files 2180b71
Shubhra Pandit commited on