---
library_name: locus
tags:
- dna
- genomics
- locally-consistent-parsing
---

# locus-2m

LoCUS-2M: width 128, 4 kb context.

- Segments: lcp (level 2)
- Width 128, 4 heads, base attention radii [32, 128], 6 segment layers
- Pretrained for 359,466 steps on GRCh38 chromosomes 3-22, crops of 256-4096 bp

## Use

```python
import locus

model = locus.load("locus-2m")
vectors = model.embed(["ACGT" * 100])
```

Code, fine-tuning recipes and the scripts that reproduce every result of the paper: see the LoCUS repository.