Quick Links
Model Card for Model ID
A version of GPT-2 trained with a differential linear transformer. See https://prdev.substack.com/p/differential-linear-attention?r=2hyugh for details.
- Downloads last month
- 10
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("prdev/gpt2-differential-linear-attention", dtype="auto")