Hugging Face's logo

gmongaras
/
Softmax_Attention_GPT_1.2B

Feature Extraction
gptj
Model card Files
xet
 Community
gmongaras commited on
Commit
ee57702
·
verified ·
1 Parent(s): f1ecb70

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -3,4 +3,4 @@ license: mit
3
  pipeline_tag: feature-extraction
4
  ---
5
 
6
- This repository contains the GPT-1.2b described in [Cottention: Linear Transformers With Cosine Attention](https://huggingface.co/papers/2409.18747).
 
3
  pipeline_tag: feature-extraction
4
  ---
5
 
6
+ This repository contains the GPT-Soft-1.2b model described in [Cottention: Linear Transformers With Cosine Attention](https://huggingface.co/papers/2409.18747).