biology
genomics
DNA
gbrixi commited on
Commit
f733268
·
verified ·
1 Parent(s): 6e8a3b2

Add model card with Evo2 branding

Browse files
Files changed (1) hide show
  1. README.md +44 -3
README.md CHANGED
@@ -1,3 +1,44 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - biology
5
+ - genomics
6
+ - DNA
7
+ ---
8
+
9
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/649aee789fc303937a045f6a/IGUfG31MMvDzhdjRK-nlJ.jpeg" width="70%" />
10
+
11
+ ## Evo 2 7B 262k Context
12
+
13
+ This is an intermediate version of Evo 2 7B, trained with up to a 262,144 token context length.
14
+
15
+ Evo 2 is a state-of-the-art DNA language model trained autoregressively on trillions of DNA tokens.
16
+
17
+ For instructions, details, and examples, please refer to the [GitHub](https://github.com/ArcInstitute/evo2) and [paper](https://www.biorxiv.org/content/10.1101/2025.02.18.638918).
18
+
19
+ ## Model Details
20
+
21
+ - **Base Model**: Evo 2 7B
22
+ - **Context Length**: 262,144 tokens (262k)
23
+ - **Parameters**: 7B
24
+ - **Checkpoint**: Iteration 12,500
25
+ - **Architecture**: 32 layers
26
+
27
+ ## Main Evo 2 Checkpoints
28
+
29
+ Evo 2 40B and 7B checkpoints, trained up to 1 million sequence length, are available here:
30
+ | Checkpoint name | Num layers | Num parameters |
31
+ |------------------------------|----|----------|
32
+ | [evo2_40b](https://huggingface.co/arcinstitute/evo2_40b) | 50 | 40B |
33
+ | [evo2_7b](https://huggingface.co/arcinstitute/evo2_7b) | 32 | 7B |
34
+
35
+ We also share 40B, 7B, and 1B base checkpoints trained on 8192 context length:
36
+ | Checkpoint name | Num layers | Num parameters |
37
+ |------------------------------|----|----------|
38
+ | [evo2_40b_base](https://huggingface.co/arcinstitute/evo2_40b_base) | 50 | 40B |
39
+ | [evo2_7b_base](https://huggingface.co/arcinstitute/evo2_7b_base) | 32 | 7B |
40
+ | [evo2_1b_base](https://huggingface.co/arcinstitute/evo2_1b_base) | 25 | 1B |
41
+
42
+ ## Usage
43
+
44
+ Please refer to the [Evo 2 GitHub repository](https://github.com/ArcInstitute/evo2) for detailed usage instructions and examples.