gabrielbianchin commited on
Commit
d787692
·
verified ·
1 Parent(s): 066eb21

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -1,6 +1,10 @@
 
 
 
 
1
  ## ESM2 Long
2
 
3
- ESM2 Long is a adapted version of ESM2 architectures. It uses local attention insted of global attention, whcih permits models with longer input size. ESM2 Long models have 2,050 context size, with double size of ESM2 standard model. Several ESM2 Long models are available:
4
 
5
  | Model | Num layers |
6
  |------------------------------|----|
 
1
+ ---
2
+ title: "ESM2 Long Models"
3
+ ---
4
+
5
  ## ESM2 Long
6
 
7
+ ESM2 Long is an adapted version of the ESM2 architectures. It uses local attention instead of global attention, allowing for models with longer input sizes. ESM2 Long models have a context size of 2,050, double that of the standard ESM2 model. Several ESM2 Long models are available:
8
 
9
  | Model | Num layers |
10
  |------------------------------|----|