Instructions to use charmander-33/opt-66b-0.7x-eigenattn with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use charmander-33/opt-66b-0.7x-eigenattn with Transformers:
# Load model directly from transformers import AutoTokenizer, OPTForCausalLM_EigenAttn tokenizer = AutoTokenizer.from_pretrained("charmander-33/opt-66b-0.7x-eigenattn") model = OPTForCausalLM_EigenAttn.from_pretrained("charmander-33/opt-66b-0.7x-eigenattn") - Notebooks
- Google Colab
- Kaggle