locus / locus-2m /README.md
esirvan's picture
LoCUS release weights
83cfd16 verified
|
Raw History Blame Contribute Delete
523 Bytes
metadata
library_name: locus
tags:
  - dna
  - genomics
  - locally-consistent-parsing

locus-2m

LoCUS-2M: width 128, 4 kb context.

  • Segments: lcp (level 2)
  • Width 128, 4 heads, base attention radii [32, 128], 6 segment layers
  • Pretrained for 359,466 steps on GRCh38 chromosomes 3-22, crops of 256-4096 bp

Use

import locus

model = locus.load("locus-2m")
vectors = model.embed(["ACGT" * 100])

Code, fine-tuning recipes and the scripts that reproduce every result of the paper: see the LoCUS repository.