Instructions to use Franzabner/attention-head-surgery-epi with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Franzabner/attention-head-surgery-epi with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Franzabner/attention-head-surgery-epi", dtype="auto") - Notebooks
- Google Colab
- Kaggle
attention-head-surgery-epi
Attention head removal measured by EPI -- do remaining heads compensate?
Placeholder -- full content coming soon. See the GitHub repo for current work.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support