metadata
license: apache-2.0
language:
- en
tags:
- biology
- medical
- code
- NLP
- Genomics
DNABERT-2 MosaicBERT Architecture; created new model from scratch
Converted from Composer checkpoint.
This model build uses Flash Attention 2 and ignores triton; the max_seq_len parameter is set to 170 and trained using amp_bf16 precision parameter.